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PREFACE 



THE NEED FOR instiwtional research 
in colleges and univerl^ies is rapidly 
being recognized. Increased emphasis 
on analyses of institutional data has 
been fostered by the rapid changes in 
the role of education in preparing 
persons for local, state, national, 
and international service. 

Enrollments have increased rapidly 
and shortly will increase even more 
rapidly; physical plants must be 
planned so as to most effectively 
meet future needs; the rapid expan- 
sion of knowledge and increasing num- 
ber of necessary disciplines require 
careful consideration of future cur- 
ricular offerings; more must be known 
about students and their backgrounds 
in order to establish the best admis- 
sions policies for the particular in- 
stitution; the goals and objectives of 
the institution must be reevaluated, 
and revised on the basis of that eval- 
uation should the evaluative research 
indicate desirable changes; it is im- 
portant to know more about the faculty 
and non-academic personnel of the in- 
stitution; the role of the institution 
in teaching, research, and service 
functions must be considered in order 
that there will be a proper balance of 
these functions; the various institu- 
tions should evaluate their offerings 
in terras of inter-state needs--this 
requires inter-institutional research; 
careful study is required of the place 
and advantages of the newer teaching 
media for learning. These are only 
some of the problems facing colleges 
and universities. 



The Planning Committee for the 
Third National Institutional Research 
Forum recognized the many problems 
which might be discussed at the Forum 
meetings. That Committee was selec- 
tive in its determination of the gen- 
eral issues which would be discussed. 
It also was felt that the results of 
research in one institution might not 
apply to another institution but that 
the methods for doing the research 
would be of interest to all institu- 
tions. Therefore, the Forum was di- 
vided into general and special sem- 
inars concentrating as much as pos- 
sible on methodology. It was assumed 
that the participants already were 
familiar with the purposes of and the 
organization for institutional re- 
search. 

Audience participation was recom- 
mended in order that there could be 
free exchange of ideas and methodol- 
ogies. However, the speaker and 
panelists were asked to set the theme 
for each respective seminar or clinic 
session. 

Although the editor of this pub- 
lication recognizes the great worth 
of the exchange between the audience 
and the speaker and panelists, the 
publication is limited to the papers 
presented at the various sessions. 

He may or may not agree with the 
authors of the papers . References 
and general footnotes for each paper 
appear at the end of the paper. 

In bringing these papers together, 
it is the hope that the publication 
will contribute to a better under- 
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standing of methods for analyses of 
data, the results of which might con- 
tribute to more sound administrative 
judgments and decisions. I personally 
and on behalf of the Planning Com- 
mittee express deep appreciation to 
the authors of the papers for their 



contributions to the National Institu 
tional Research Forum and for releas- 
ing the papers of the Forum sessions 
for publication. 

L. Joseph Lins 
Editor 
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A UNIVERSITY PRESIDENT LOOKS AT 
INSTITUTIONAL RESEARCH 
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University of Rhode Island 



IT IS a pleasure to open this Na- 
tional Institutional Research Forum. 

I have some temerity in speaking to- 
night^ however^ in the presence of so 
many pros in the field. You have 
lined up a terrific group of pai'tici- 
pants, some of whom know more about 
higher education than I ever will in 
spite of the fact that in addition to 
being a university president I am, by 
title anyway, a professor of higher 
education. I ought to speak softly 
in a conference at which you will hear 
from such experts as John Dale Russell, 
whom I once served as assistant dean 
and from whom I learned a good deal, 

A. J. Brumbaugh, whose pamphlet I trust 
you have all read. Algo Henderson, Jim 
Doi, Lew Mayhew, John Jamrich, Bob 
Bokelman, Ray Carpenter, Sam Baskin, 
and many others. But some of those 
on the planning committee know I never 
speak softly and know my predilection 
for controversial statements. They 
believed my remarks tonight might help 
precipitate you rather forcefully into 
your deliberations. 

Certainly, I doubt if you can find 
a university president who is more con- 
vinced of the value of institutional 
research than I am. I established out 
Office of Institutional Research in 
the spring of my first year as presi- 



dent of URI, snaring as its director 
Ted Hallenbeck, whom I regard as one 
of the best institutional research men 
in the business. He has done a ter- 
rific job, yet I am far from satisfied 
with the operations of his office. 

Much as we are doing at Rhode Island, 

I believe we are only scratching the 
surface so far as institutional re- 
search goes. In any case, I have some 
ideas about institutional research, 
which I am glad to toss cut for your 
consideration. They are perhaps a bit 
unorthodox and not in accord with the 
views of some of the leading institu- 
tional research practitioners. But I 
trust you will find them helpful. 

After the habit of academic man, 
let me begin with a definition. I find 
Dr. Brumbaugh's quite adequate. Insti- 
tutional research includes, he states, 
"Studies and investigations focused on 
current problems and Issues in institu- 
tions of higher education « . . (aleo) 
studies and investigations of problems 
and issues that are basic to long-range 
planning or that may ultimately have 
implications for institutional opera- 
tions."^ The ultimate goal of insti- 
tutional research, NEBHE says, is to 
base policy decisions on reliable in- 
formation about the institution itself. 
Since mfiiny educators and management 




2 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



experts distinguish policy from oper- 
ating decisions, I am inclined to 
leave out the term "policy.” Cer- 
tainly Brumbaugh is correct when he 
writes: "The key to effective admin- 

istration is the ability of the presi- 
dent and those who work with him to 
ask the right questions and then find 
the right answers. But the right an- 
sv/ers . . . must take into account all 
the relevant, factual data-- the kind 
of data that only institutional re- 
search can provide. "2 

Ideally, the preside.it should be 
his own director of institutional re- 
search. There is value for him even 
in gathering raw data. The president 
is supposed to be the one individual 
who sees the institution in its whole- 
ness. He learns about the institution 
as he gathers facts about it and stud- 
ies them. But he is just too busy to 
do the research, so he must rely upon 
the office of institutional research 
to do it for him. 

More than any other single indivi- 
dual, the president has the responsi- 
bility (1) for insuring that the in- 
stitution is run effectively day by 
day, and (2) tor planning intelligent- 
ly for the institution's future devel- 
opment. He has many colleagues who 
share various aspects of this broad 
responsibility, but the president re- 
mains the key figure. 

I'u many cases, however, as Presi- 
dent Dodds has pointed out in his 
recent book on the college presidency, 
he has lost control of the task--not 
in any sense of autocratic power, but 
merely in the sense of influencing to 
any significant degree the operation 
and development of the college or uni- 
versity he heads. I look upon the 
office of institutional research bas- 
ically as an administrative agency to 
nelp the president and his major aca- 
demic and non-academic colleagues to 
r-.gain some measure of contr'*l over 
the institution, so that it can be 
operated more intelligently, effi- 
ciently, and effectively. 



The results of institutional re- 
search are not to be used primarily to 
ram some administrative decision doiv 
the throats of an opposing faculty, 
although if the research results are 
clearcut enough, this may on occasion 
be justified. But if the research is 
used properly, and if there is full 
and free discussion with the faculty 
or others involved or concerned-- the 
students or alumni, for example — the 
results of institutional research will 
hopefully convince the faculty or 
others of the justification for changes. 
I agree with Brumbaugh's optimistic 
statement: ’’No matter how persistent 

they may be in their prejudices, or how 
ruggedly they may cling to their power 
or control, faculty members are not im- 
mune to the argument of factual evi- 
dence."^ Let me make it clear that the 
justification for an office of institu- 
tional research is not to help admini- 
strators gain some measure of control 
they have lost largely in the post-war 
expansion and reorientation of higher 
education. Its justification is that 
institutional research provides data 
upon which intelligent decisions can 
be made. I do happen to think, how- 
ever, that wise decisions are more 
likely to be made if administrators 
have more influence within their in- 
stitutions than at present. But re- 
gardless of the role one assigns to 
the president in institutional policy 
determination and in operating deci- 
sions, and to his major administrative 
colleagues, the need for institutional 
research is obvious. 

Yet the role and importance of in- 
stitutional research has been very slow 
of recognition. Stickler's^ study, 
made in 1958-59, showed that only about 
one-fifth of the land-grant colleges 
and state universities had full-time 
coordinators of institutional research. 
There are a good many more since then, 
but institutional research hasn't 
caught on everywhere by any means. 

What are the reasons for this slow 
growth and failure to recognize the im- 
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portance of institutional research? 
Institutions of higher education have 
an ancient lineage — they are the de- 
scendents of the great medieval uni** 
versities of Paris and Bologna, of 
Oxford and Cambridge. Like all human 
institutions with such long pasts and 
traditions, they are fundamentally re- 
sistant to change. They tend to go on 
doing things in the same old, presum- 
ably time- tested ways. The organiza- 
tional set-up of colleges and univer- 
sities, moreover, with its conflicting 
and ill-defined division of responsi- 
bilities for decision-making, does not 
facilitate and promote change. The 
nature of academic men, brought up in 
this system and in effect conditioned 
by it, reflects these circumstances. 
President Dodd points out what every 
president soon learns from experience: 
"Our faculties are, of all the profes- 
sions, the most resistant to change 
and in a fine strategic position to 
exercise that resistance."^ 

Another characteristic of the aca- 
demic man that has hindered the devel- 
opment of institutional research is 
that he regards himself as an expert 
on education. In his own field of 
specialization, he makes judgments on 
the basis of the evidence. He is 
research-minded. He withholds judg- 
ment until he has examined the facts. 
But in educational matters, personal 
experience is regarded an adequate 
basis for conc)asions and practices. 
Consequently, positions are often 
taken and decisions arrived at on the 
basis of assumptions which may never 
have been tested or which educational 
research may long since have proved 
to be without foundation. Consider, 
for example, the continued advocacy 
of certain traditional subjects be- 
cause they "train the mind," and the 
corollary, the transfer of training, 
although psychology has long disproved 
or qualified the contentions. Or con- 
sider the almost religious convictions 
of many faculty members concerning the 
superior merit of small classes, the 



faculty-student rario as a measure of 
institutional quality, the nece f-ity 
of regular class attendance, and other 
long held items in the extensive folk- 
lore of academia. 

So faculties hold fast to their 
accustomed routines and practices. 
Academic bookkeeping is little changed 
from earlier days. Classes for the 
most part still meet three times a 
week, with lectures scheduled for the 
morning hours and laboratory periods 
in the afternoon, and the academic year 
still follows a calendar justified only 
by an agrarian society of long ago. 
These traditional ways may be the best 
ways to do things, but we need more 
objective evidence. Lacking it, col- 
leges and universities have muddled 
through. Faculty committees have 
pooled their ignorance and their prej- 
udices and the institutions go on do- 
ing the same old things, though often 
under new labels, which fool only the 
public — and not even the public for 
long.’ 

Most of the significant experiments 
in higher education since World War I 
have made little headway. They have 
disappeared, like the four-year junior 
college, or come closer to the main 
stream of American higher education, 
as with the experimental colleges such 
as Rollins, Bard, Bennington, and Sarah 
Lawrence. After a quarter century, no 
college has followed St. John's, al- 
though it now has plans to establish a 
second St. John's in New Mexico. No 
one has set up the New College outlined 
by Shannon McCune and his colleagues, 
however sound and logical its blue- 
print. Dozens of new institutions are 
started every year, but basically they 
are all in the standard pattern. In 
spite of all our vaunted diversity of 
American higher education, there is 
little real diversity. Whether pri- 
vately or publicly controlled, small 
or large, poor or rich, our colleges 
and universities are, at bottom, very 
much the same. Variations from the 
standard pattern and practices are 
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rare and fundamental changes within 
institutions come slowly, I must ad- 
mit, rather unhappily, that many pres- 
idents are just as inclined as are 
faculties to make decisions based upon 
hunches, prejudices, prior experiences, 
«,tc., and to maintain the academic 
tatus quo. 

Yet to continue to operate colleges 
nd universities in the future as they 
have been operated in the past, to go 
on making decisions by such unscienti- 
fic and ad hoc means as have prevailed, 
can only lead to the failure of higher 
-ducation to meet the challenges and 
opportunities ahead, if not, indeed, 
to downright disaster. It is time we 
all, those of us in the institutions 
and the public as well, recognized that 
higher education as usual just won’t do. 
In the years immediately ahead, col- 
leges and universities will develop in 
the light of two overriding conditions-- 
growth and change. 

The facts on* growth are so well 
known to you that I need scarcely men- 
tion them. This year's better than 
four million full- and part-time col- 
lege students will probably double in 
one decade and possibly triple in two. 
The increase in the numbers of under- 
graduate students will surely be ex- 
ceeded, percentage-wise, by the in- 
crease in graduate students. The de- 
niand for specialized training in al- 
most all fields has made a master's 
degree almost mandatory in many pro- 
fessions where heretofore a bachelor's 
degree was adequate. The doctor's de- 
gree becomes increasingly the card of 
admissions, or at least of advancement, 
in an increasing number of fields. 
Post-doctoral work has already begun 
to impose serious burdens on many uni- 
versities. 

The rapid expansion of the numbers 
of students calls for a major increase, 
though not proportionate to student 
growth, in the mm.ber of institutions. 
New institutions of all kinds will come 
into existence and branch campuses of 
existing institutions will multiply. 



The modification of institutions will 
accelerate, with junior colleges becom- 
ing senior colleges, single purpose in- 
stitutions becoming complex, and col- 
leges becoming universititj Such in- 
stitutional changes, incidentally, 
should be soundly based on careful 
research studies. 

Necessary to meeting the needs for 
expansion, of course, must be more 
inter-institutional cooperation, and 
more state and regional planning. Many 
states are tackling the problem of meet- 
ing the expanding needs for higher edu- 
cation on a state-wide basis, and state 
surveys of higher education have become 
commonplace. The latest master plan in 
California is one of the roost thorough- 
going, and surely one of the most inter- 
esting, attempts to plan a coordinated 
attack on expanding higher education. 

Each institution, regardless of its 
nature, will face the pressures for 
growth. Most of the expansion will have 
to be met by publicly supported colleges 
and universities. It is unlikely, how- 
ever, that even the most selective of 
private institutions will be able to re- 
sist growth pressures, no matter how de- 
termined they may be to hold to their pre- 
sent enrollment. Growth, both within 
each institution, and within all higher 
education, will present a continuous 
problem in the years ahead. Institu- 
tional research studies are essential 
to institutional decisions about meet- 
ing the problems of growth. 

But perhaps even more significant 
in relation to institutional research is 
the fact of change other than growth. 

It will be much harder, I believe, for 
institutions to provide for curricular 
change, than for mere expansion of num- 
bers of students. Yet curricular change 
is inevitable, made necessary by the ex- 
plosion of knowledge, with resulting 
modifications in training foi the pro- 
fessions, In some fields, our knowledge 
is doubling in a decade. In many, know- 
ledge is changing so rapidly that what 
one has learned in college is soon out- 
of-date, Technology is moving so fast. 
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for example, that engineers gradwt'ng 
this June will find half of what they 
know obsolete in 1973, and only half 
of what they will need to know in 1973 
is now available to them. 

Certainly, seme curriculums that 
prepare for specific jobs will disap- 
pear and new job categories for which 
collegiate preparation is essential 
will fi. d their way into the curricu- 
lum. Nuclear engineering and space 
science are examples of relatively 
new areas for which the universities 
have had to make place in their cur- 
riculums. The ui iversities, the pri- 
mary discoverers of new knowledge, 
will need to incorporate such knowledge 
promptly into their teaching and in 
other ways adjust to the rapid 
changes that will affect higher educa- 
tion. This will be no easy task. The 
history of higher education reveals a 
continuing resistance to the admittance 
of new knowledge and new fields of 
study into the curriculum. In the 
fifteenth and sixteenth centuries, it 
was Greek humanistic studies; in the 
eighteenth and nineteenth, science, 
and then modern language and litera- 
ture, and the social sciences. In the 
twentieth century, it has been various 
vocational fields. But if higher edu- 
cation is to discharge its obligation 
to society, it must find ways to 
change. 

What are some of the concomitants 
of the constant growth and change that 
lie ahead and what are their implica- 
tions for institutional research? 

First of all, it is evident that 
costs will mount substantially. From 
its current cost of less than five bil- 
lion annually, it is estimated that by 
1970, the cost of higher education in 
America will be between eleven and 
thirteen billion. Certainly, we must 
know more than we have been content to 
know in the past, about where the money 
is coming from and how it is spent. 
Since the cost is so great, moreover, 
we must endeavor to see that the funds 
are spent more economically and effi- 



ciently in all areas of operation. 

Second, it is certain that we face 
shortages of competent faculty members, 
critical shortages in some fields. 
Consequently, we must find ways of 
using our faculty more efficiently. 

We must search for substitutes for the 
traditional teaching procedures. 

Third, there is greater need than 
ever before for effective planning. 

Our planning must be better, it must be 
more inclusive, and it must concern it- 
self with both immediate and long-range 
plans, with the long-range plans subject 
to periodic review« As I have indicated, 
moreover, there is need for more inter- 
institutional planning as a means of 
meeting the problems facing higher edu- 
cation. 

Finally, there is more need for pub- 
lic relations than heretofore. The in- 
creasing pressures for college admis- 
sions, all of which cannot be met, and 
which will be a special problem for cer- 
tain institutions; the mounting cost of 
higher education; and the generally more 
vital role which colleges and universi- 
ties play in the national welfare — all 
these matters must be explained to the 
public. The people, whether or not 
they are the consumers of higher edu- 
cation, cannot be disregarded. They 
will need to have facts about the needs, 
the changes, the responsibilities of 
institutions of higher education. 

Institutional research has a role 
in all these matters. One cannot find 
a better statement of the imperative 
need of institutional research than in 
the resolutions of the 1962 Annual Na- 
tional Conference on Higher Education.^ 
Resolution Number Two stated: 

"In recognition of our responsibil- 
ity to make the most effective use of 
our present human, physical, and finan- 
cial resources, we believe it imperative 
that institutions of higher learning 
keep their own houses in order. To this 
2 nd, this conference recommends; 

1. that each institution identify 
clearly its own particular pur- 
poses and functions and direct 
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its energies to the fulfillment 
of these ends. 

2. chat each institution make max- 
imum use of present resources 
by reviewing its policies and 
practices with particular at- 
tention to its provisions for 
faculty salaries, fringe bene- 
fits, incentive programs, in- 
structional methods, teaching 
loads and research activities, 
its student- faculty ratios, and 
space utilization. 

3. that each institution, in the 
light of its definition of pur- 
pose and function, examine its 
programs of student selection, 
financial aid, academic place- 
ment, counseling, and provi- 
sions for transition from 
school to college, from junior 
college to other colleges, and 
from college to professional 
and graduate study, 

4. that each institution join with 
neighboring colleges and uni- 
versities in exploring ways and 
means of combining resources to 
eliminate unnecessary duplica- 
tion and to supplement each 
others’ faculties, facilities, 
and programs. 

5. that institutional faculties 
and professional associations 
in their free and intensive 
pursuit of knowledge in ever 
increasing specialization de- 
vote attention and respect to 
our common intellectual herit- 
age and, in particular, to 
bridging gaps between discir. 

p lines so that the unity of 
knowledge may be transmitted 
to our students." 

The means of carrying out effec- 
tively the various parts of this reso- 
lution lie in institutional research. 

To do the job most effectively requires 
also a special bureau or office of in- 
stitutional research. Let me now take 
a look from the standpoint of a univer- 
sity president at the role of institu- 



tional research in terms of the specif 
ics it should be dealing with, the 
studies it should be making. Let me 
acknowledge that what follows has not 
been researched itself, and is, in a 
sense, a violation of the spirit of 
institutional research. It springs 
primarily from my personal knowledge 
and experience and may reveal more 
ignorance of your field than a univer- 
sity president should be caught with. 

I’m sure most of you believe, no doubt 
with justification, that some presiden- 
tial ignorance is par for the course.’ 

It is evident to every university 
president that an institutional research 
office is necessary if for no other 
reason than to fill out the multitude 
of questionnaires that flood his mail. 
Completing questionnaires is certainly 
one of the more Immediately useful 
responsibilities of the institutional 
research office. Let me suggest some 
of the major areas with which it must 
be concerned. 

Perhaps the earliest role for in- 
stitutional research was in planning, 
especially forecasts of enrollment, 
both immediate and long-range. We are 
getting pretty good data on enrollments, 
at least at the undergraduate level, 
and by major divisions of schools and 
colleges.. But what we are not getting — 
and perhaps cannot get reliably, is 
forecasts of enrollments by departments, 
especially at the graduate level. The 
determination of graduate enrollment is 
dependent upon artificial causes, be- 
cause an institution buys graduate stu- 
dents, and trends are difficult to es- 
tablish, Forces over which the insti- 
tution has little or no control influence 
graduate enroli’^.iat-- federal programs 
and subsidies, foundation support, and 
research grants. Arguments that an in- 
stitution doesn't have to accept these 
handouts are unrealistic given today’s 
attitude toward such largess. 

The institution has really lost 
control of its graduate program, once 
the decision has been made to begin 
graduate work in a particular field. 
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Decisions on expansion often represent 
the forces so well outlined in that 
famous account, known to most of you, 
I'm sure, of the initiation and devel- 
opment of a program in Alligator Farm 
Management . 

I don't know if institutional re- 
search can bring some order out of 
this chaotic situation or not — but it 
should try. Certainly there is need 
to forecast the need for faculty and 
facilities at all levels of instruc- 
tion on the basis of careful study of 
what is essential to department and 
school or college. All too often, 
however, decisions are made on the 
basis of mere statements by a depart- 
mental chairman or a dean. He reports 
that he needs a new faculty member. 

How often is any investigation made 
to determine if the stated need is 
actually justified? Budgetary con- 
siderations are often taken into ac- 
count, but seldom on the basis of 
definite and relevant facts. 

The handling of facilities may be 
somewhat less hit or miss, but it too 
is seldom based on needs demonstrated 
by institutional research. The faculty 
complains of shortages of space. Some- 
body decides a new building is needed. 
The faculty plans it, then the plans 
are trimmed in terms of the funds 
available. But seldom are any of the 
decisions made in the light of care- 
fully documented facts as to need. 
Certainly, institutional research help 
is essential if the planning for fac- 
ulty and plant expansion is to be done 
on any rational basis. The need for 
new facilities is tied in, of course, 
with space utilization studies and en- 
rollment forecasting — but much more 
remains to be done if institutional 
building is to reflect actual need. 

In this connection, each institu- 
tion should have a campus master plan, 
kept up to date by periodic revision 
based on actual experience. Priorities 
must be determined, although again, 
they must be continuously scrutinized 
to adjust, if necessary, to changing 



circumstances c The office of institu- 
tional research should be the one re- 
sponsible for liaison with the campus 
planners, if an outside agency is used, 
and for the constant evaluation of the 
plan. It is particularly important 
that planning for residence and dining 
facilities be accurate, since these are 
financed out of current income and there 
is little leeway for error. 

The role of institutional research 
in planning involves housekeeping stud- 
ies — on space utilization, class size, 
teaching load, etc. After enrollment 
forecasting, such studies are the most 
common and generally the most success- 
ful of the office of institutional re- 
search, But too much institutional 
research effort in this respect does 
not go beyond status studies. In room 
utilization, for example, using the 
Russell-Doi formulas, one comes out 
with an idea of the comparative utili- 
zation percentage-wise, of laboratories 
and classrooms. But this is not enough. 
What use is made of these data? What 
suggestions does the office of institu- 
tional research have for more effective 
utilization, say by the redesign of 
existing space? Or by better control 
of class schedules? 

When it comes to class size, the 
typical institutional research study 
provides information on the number of 
classes with different size enrollments. 
But seldom does it suggest reasons for 
the situation or make recommendations 
for improvement. Studies of teaching 
load are statistically interesting. 

But do they attempt to make sense out 
of the statistics in terms of the nature 
of the load, of the subject taught, and 
of the interests and capabilities of the 
individual faculty member? 

I am pleading, therefore, to have an 
office of institutional research that is 
more than a statistics-gathering agency. 
The facts are necessary. But the office 
of institutional research must interpret 
them, indicate their meaning and impli- 
cations, and recommend modifying action 
if appropriate. The office of institu- 
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tionsl research, as I said in the be- 
ginning, renders advisory services to 
the president and other administrators; 
this should involve suggesting appro- 
priate courses of action. This leads 
me to a third important area of insti- 
tutional research--faculty studies. 

The most obvious are those related to 
salaries, both within the institution 
and in comparison with faculty salaries 
in comparable institutions and through- 
out higher education, although I am in- 
clined to regard these latter data as 
of little real value. It is time for 
salary data that are more realistic. 

Many salary studies fail to present 
information which is meaningful, be- 
cause the complete salary picture is 
lacking. Supplemental institutional 
income, as from extra teaching and re- 
search, and the handling of fringe bene- 
fits obscure the facts. The AAUF salary 
reports, for example, leave much to be 
desired for useful comparisons. 

Much more remains to be done at most 
colleges and universities on other stud- 
ies concerning the faculty. Brumbaugh® 
rightly points out: "Faculty charac- 

teristics, needs, functions, conditions 
of service, morale, motivation, outlook, 
imagination, these are only a few of the 
subjects that are appropriate for insti- 
tutional research." For example, how 
many institutions have made studies of 
the loss of faculty personnel? For many 
years we have hollered about the loss of 
teachers to business and industry be- 
cause of allegedly higher salaries. How 
many of us have really studied the record 
in our own institutions? 

There is need for research that will 
bring more intelligent practices into 
the recruitment of new faculty. Higher 
education can’t hold a candle to busi- 
ness and industry when it comes to the 
efficient recruitment of new personnel. 
The office of institutional research 
could surely help find ways to make fac- 
ulty recruitment less a hit or miss 
proposition, less subject to chance and 
more determined by sound recruiting 
techniques. 



A fourth area requiring more and 
better institutional research is insti- 
tutional costs. Some standardized pro- 
cedures have been established which pro- 
vide better cost data, but much remains 
to be done — in the area of budget anal- 
ysis, for example. We know too little 
about the cost of particular operations. 
We should know not what we are spending 
for admissions or for placement, for 
example, but what the cost is per stu- 
dent recruited or placed and why it 
costs what it does. Then comparative 
data are needed which will help us de- 
termine whether or not we are spending 
too much for such services. Do we have 
a planned program of promotion, or Jo 
we rather accept the word of a depart- 
ment chairman or a dean that hib opera- 
tion needs a new brochure and make a 
decision primarily on the basis of 
whether or not the budget can stand the 
added expense? 

Much more information should be 
available to administrative officers on 
unit costs — not just the cost per stu- 
dent, for example, but the cost per stu- 
dent by department and school, under- 
graduate and graduate. There is much 
folklore about the cost of educating 
students, and we are all less than scru- 
pulous in talking about the subject. 

Even the Council for Financial Aid to 
Education is guilty of maintaining that 
"no student ever pays the cost of his 
education." This is nonsense. Not a 
few institutions exist off student fees, 
and pay for their buildings out of such 
income. In most colleges and universi- 
ties today, students are not only paying 
the cost of operating and maintaining 
dormitories, dining halls, and unions, 
they are paying construction costs and 
interest charges as well. 

I suspect that even at Harvard if 
adequate cost studies were made, separa- 
ting support for graduate education and 
research, they would show that the tui- 
tion paid by undergraduates actually 
covers the cost of their education. 

The last time I saw the figures (they 
were for 1959-60) Yale stated that the 
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net cost to Yale per student was $1602. 
Upon inquiry, I was informed that the 
figure was arrived at by a form^-la 
which took the total university expen- 
ditures, subtracted income from charges 
on term bills and from gifts (exclusive 
of the Alumni Fund), and divided the 
difference by the total university en- 
rollment. The result was the net cost 
of Yale's annual subsidy to each stu- 
dent. I question the defensibility of 
the formula. 

The practice of my predecessor at 
the University of Rhode Island was just 
as indefensible. Every year, he pub- 
lished figures on the cost per student 
to the state. He arrived at his fig- 
ures by dividing the total state ap- 
propriation by the number of full- 
time students. But what about the 
part-time students? The Evening Col- 
lege operation was subsidized. And 
should the student be credited with 
the cost of agricultural research and 
extension which required state funds? — 
or the cost of the increasingly numer- 
ous service functions state institu- 
tions, and many private institutions, 
render? Should the cost of rare books 
purchased for the library, or of ex- 
pensive pictures for the art gallery, 
the cost of research or testing equip- 
ment for faculty research, be charged 
to the cost of educating the under- 
graduate student? 

And what about significant figures 
in connection with increasing enroll- 
ment? At what point, for example, do 
additional administrative or other 
costs make additional enrollment with 
its tuition income a loss rather than 
a gain? 

It is increasingly difficult to get 
meaningful and useful figures--but we 
must somehow try to get them. We need 
figures for the operation of depart- 
ments, in terms of undergraduate and 
graduate enrollments, majors and non- 
majors, service courses for other de- 
^'aitments and schools, research, basic 
and applied (with income from grants, 
‘'cllowships, etc., clearly identified). 



We need more, we need to have data con- 
cerning minimum and optimum needs for 
an instructional or research program. 

In agriculture, for example, how many 
acres are necessary for a particular 
crop to make the research results reli- 
able, or how many cows must there be in 
a dairy herd to satisfy instruction in 
dairy husbandry? In psychological or 
medical research, how many cats or dogs 
must be used for experiments to produce 
reliable results? The animals cost 
money. The faculty member requests a 
certain number. What data are avail- 
able to help the administration decide 
if the number requested is necessary? 

I'm probably barking up an impos- 
sible tree but, as a university presi- 
dent, I feel practically helpless be- 
fore such questions. Maybe all I can 
do is to trust faculty memb'^rs and my 
administrative colleagues to be reason- 
able. But after thirty years in col- 
lege work, I would feel a lot more com- 
fortable if facts were available to 
justify the requests. Perhaps the of- 
fice of institutional research can't 
provide such facts. But I'm not aware 
that many are even attempting to get 
the data. And we are really hurting 
to have it. As the cost of higher edu- 
cation grows ever more burdensome, in- 
creasingly better cost data are essen- 
tial to effective and economical opera- 
tion. 

The matter of cost ties in with a 
fifth area of concern to institutional 
research — the administration. Parkin- 
son's Law is as characteristic of col- 
lege administration as expansion is of 
academic departments . Consequently, 
administrative operations need the scru- 
tiny of the office of institutional re- 
search and the facts basic to intelli- 
gent decision making. This should ex- 
tend to administrative organization as 
such, and also the matter of so-called 
faculty government, including faculty 
participation in institutional policy 
determination. I need scarcely mention 
the area of improved admiijistrative 
techniques, as through the use of 
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machine methods and data processing 
equipment. Considerable institutional 
research is being carried on in such 
matters, although more is essential. 

I have pointed out the need for ex- 
tending, improving, reforming institu- 
tional research in the areas of 1) en- 
rollment forecasting, 2) institutional 
planning, especially in the expansion 
of faculties and facilities, 3) faculty 
studies, 4) cost analyses, and 5) ad- 
ministrative efficiency. Let me now 
turn to some suggestions regarding the 
need of the office of institutional 
research to rethink and replan its 
operations. 

In one area, the study of institu- 
tional goals and objectives, there is 
decreasing need for activity. I am 
willing to concede that every institu- 
tion from time to time is justified in 
reexamining its fundamental purposes. 
But I question whether much real good 
results. The reexamination, in many 
cases, is not primarily a task for 
the office of institutional research, 
although it will be involved through 
the provisions of relevant data. The 
job is one essentially for the faculty 
and will for a time keep them out of 
other mischief. 

Similarly, I take a somewhat dim 
view of comprehensive institutional 
self-studies, popular though they are 
and endorsed by many educational ex- 
perts. There is value in the process-- 
f acuity members and administrators 
gain something by their involvement. 

But generally few significant changes 
result. The report is a series of 
compromises, arrived at as a result 
of faculty arguing of their usual 
prejudices. I remember that when 
Carroll Newsome, then president of 
NYU, presented at a special confer- 
ence of educators the NYU self-study 
report (financed by a foundation 
grant of $400,000), he commented that 
it would make a good door-stop. It 
was indeed a heavy volume. President 
''■•wsome candidly doubted it was worth 
''•It it had cost. 



I The office of institutional re- 

search should be involved in continuing 
activities, many, admittedly, not un- 
related to those comnonly associated 
with a self-study. For example, insti- 
tutional research is not achieving its 
potential in the area of evaluation. 

There should be more evaluation of the 
results of the institution's educational 
efforts — of the success, attitudes, and 
non-occupational activities of graduates, 
including records of baccalaureate grad- 
uates in graduate and post-baccalaureate 
graduate education. Most alumni studies 
have unfortunately been left to the 
alumni office, which is not properly 
equipped for such activity. 

There is need for more evaluation 
of student achievement. Detailed cor- 
relation studies with admission prac- 
tices, source of students, etc., are 
needed. Analyses of grades, of shifts 
in student objectives, and of mortality, 
by department and when appropriate, by 
individual professors, are needed. For 
the office of institutional research to 
make such analyses is treading on sacred 
ground, I realize, but we must give more 
and more attention to teaching effective- 
ness, and such analyses are relevant. I 
recognize the doubts and difficulties 
which make faculty members object to 
almost any attempt to evaluate teaching. 
But how are intelligent judgments to be 
made about faculty advancement without 
such evaluation? 

There is need, furthermore, for 
more detailed evaluation of research 
accomplishment. When a board of deans 
and the president are considering pro- 
motions, etc., how is there to be any 
real judgment on the value and impor- 
tance of the published papers listed 
on the evaluation sheet submitted by 
the responsible dean? I recognize that 
the people staffing the office of in- 
stitutional research can't be specialists 
in the evaluation of a professor's re- 
search, but by studying the data sub- 
mitted, especially when looked at in 
conjunction with all such reports and 
recommendations, they can help the 
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president ask the right questions of 
the deans and be better acquainted with 
the performance of the total faculty. 

The difficulty of doing this in a large 
university is obvious, but in such an 
institution the help is valuable to 
other administrators involved in fac- 
ulty evaluation, as well as to the 
president. 

Much more attention needs to be 
given to the curriculum, especially to 
its proliferation. In too many col- 
leges and universities, control of the 
curriculum has got beyond the admini- 
stration. This is basically why Ruml 
made his proposal to lodge more of the 
control in the Board, working with the 
faculty and administration, not inde- 
pendent of them as Rirail's critics have 
so often maintained. I sit by help- 
lessly, as month after month, I see 
the lists of new courses approved by 
the Graduate Council and the Faculty 
Curriculum Committee and then have to 
provide funds to hire the faculty to 
teach the new courses. More study of 
this matter by the institutional re- 
search people could, I believe, help 
the president, not to control the cur- 
riculum — control can never be recap- 
tured by the president, and indeed it 
is probably undesirable that it should 
be — but to put the expansion of the 
curriculum on a more sensible basis. 

The final area to which the office 
of institutional research needs to give 
greater attention is that of experimen- 
tation. Experimentation in higher edu- 
cation is increasing but there is still 
far too little. More is needed con- 
cerning teaching methods, independent 
study, class size, etc. In some cases, 
these experiments need to be brought 
down to the individual professor, to 
help him utilize his abilities most 
effectively. Certainly, efforts are 
needed through experimentation to con- 
vince faculty members that such time- 
tested practices as the three-hour-a- 
week class are at last open to question. 

In this connection, the local office 
of institutional research has an obli- 
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gation to become a clearing house for 
the results of research concerning 
higher education. It must report the 
conclusions of relevant studies and ex- 
periments in other colleges and univer- 
sities. Special need exists for the 
development of more norms and standard- 
ized procedures. This means more com- 
munication and more cooperation among 
institutional research offices. A first 
step may be a formal organization of 
you institutional research people — al- 
though most of us feel that higher edu- 
cation is already overly organized. 
Surely, a journal or bulletin reporting 
problems of interest, studies in prog- 
ress, results and recommendations, 
would be extremely helpful and I urge 
you to establish such a publication — 
although again, I believe that there 
are too many educational publications 
already. 

Appropriate and interesting results 
of institutional research^ both at other 
institutions and at one's own, should 
somehow be communicated to one's faculty 
and administrative colleagues. Some 
internal studies, of course, are for 
the president and his associates 
alone — but most of the work of offices 
of institutional research should get 
widespread circulation. I have empha- 
sized in the beginning of my remarks 
the increai.ingly rapid change that will 
pervade higher education. As time 
honored practices are questioned, as 
changes are advocated or ordered, the 
faculty must have answers to their 
questions of why and how. The task of 
providing these answers will occupy a 
contiiiuingly increasing proportion of 
the time of institutional research 
people. 

What about faculty participation, 
therefore, in institutional research? 
There is considerable theory that the 
office of institutional research is an 
arm of the faculty, not of the adminis- 
tration. When Eckert and Kelly estab- 
lished the Bureau of Institutional Re- 
search at Minnesota thirty years ago, 
they declared: "This is not a program 
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of research dictated by deans and 
presidents, but one shaped primarily 
by faculty members who identified 
problems in their own teaching or 
counseling and volunteered to aid in 
the study of them,"^ This is not my 
concept of institutional research. 

I'm inclined not even to agree with 
Brumbaugh,^® when he writes: "A dir** 

ector of institutional research must 
guard the separation of his functions 
from the main stream of intellectual 
activity on the campus: he must in- 

volve faculty members and administra- 
tive officers jointly in planning, con- 
ducting, and interpreting results." 

I accept the desirability of some 
faculty involvement. But I reemphasize 
my basic conviction that the office of 
institutional research is an adminis- 
trative agency of the president's of- 
fice, If the director is the kind of 
a person he should be, I am convinced 
he will establish rapport with the 
faculty and the rest of the administra- 
tion. 

In view of this convinction, I be- 
lieve that the director of the office 
of institutional research should report 
to the president, not to the academic 
vice president or to any other adminis- 
trative officer. His areas of interest 
extend beyond the academic program to 
student personnel, business affairs and 
public relations. He must be a close 
adviser of the president, a person 
against whom the president can test 
idea& and with whom he can discuss any 
matter v/hat soever. No administrative 
colleague will be closer to the presi- 
dent, He must be a member of the 
president's cabinet or advisory council, 
no matter how small, and a member of 
any administrative council. Preferably, 
he should have faculty status, but this 
lies generally with the faculty itself. 
He should, of course, attend meetings 
of the faculty senate, and he will cer- 
tainly be used by the president at 
trustee meetings. He should be a mem- 
ber of certain important committees 
and all building planning committees. 



except in those institutions where the 
staff of the office is large enough to 
include an expert on building planning 
and construction, who then should re- 
place the director on such committees. 

Obviously, I am talking about a 
very high level guy. He must not be 
just an educational statistician, al- 
though he must know his statistics. 

As he expands his staff, he will employ 
statisticians and other specialists in 
such areas as space utilization, cost 
analysis, etc. But the director, 
whether operating alone or at the head 
of a large staff, must be a generalist 
in institutional research — like the 
president himself c He must know higher 
education thoroughly, including its 
history as well as its current problems. 
He must be able to interpret facts and 
studies for the board, the administra- 
tion, the faculty, and the public. So 
he needs imagination and judgment, he 
must be able to speak and to write ef- 
fectively, and he should be willing to 
work the long hours that no one in the 
institution works but the president. 

I admit there are not too many such 
guys around. Those who come up to 
these demands have the capabilities for 
the top administrative posts. The of- 
fice of institutional research is an 
excellent training ground for presiden- 
tial aspirants. If they are the kind 
of individuals I believe should direct 
the office, they will eventually make 
it, although some have more sense than 
to want to be a college or university 
president. 

In conclusion, let me summarize 
briefly what I have tried to get across 
to you tonight concerning this univer- 
sity president's view of institutional 
research: 

1. More and better institutional 
research is imperative as colleges and 
universities move into the critical 
years ahead of great expansion and 
rapid growth, with substantially mount- 
ing costs. 

2. The function of institutional 
research can best be carried out in a 
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separately organized office charged 
with the task and given appropriate 
responsibility to carry it out ef- 
fectively. 

3. The director of this office 
should report to the president and be 
one of his closest and most trusted 
advisers. 

4. The function of the office must 
be directed increasingly into the area 
of evaluation, including cost factors, 
and of experimentation. 

I trust that your deliberations in 
the next two days will suggest how in- 
stitutional research can be made in- 
creasingly significant and effective 
within your colleges and universities 
and throughout higher education. It 
has been good to kick off these delib- 
erations tonight. 
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OUR NATIONAL landscape is dotted 
with the graves of colleges that have 
succumbed to the ravages of time and 
to circumstances beyond their control. 
It is reliably estimated that over the 
years about twice as many colleges 
have disappeared from the scene as are 
now in existence. In many instances, 
the sites of these colleges can no 
longer be identified. Whether the at- 
trition of these institutions has been 
a gain or a loss to American higher 
education is a debatable question. 
Among the causes for their disappear- 
ance, undoubtedly, were poor location, 
the disappearance of a supporting con- 
stituency, fires or other catastro- 
phies, and/or a lack of adequate sup- 
port to enable them to survive the 
infirmities of old age. One thing is 
reasonably certain, at the time when 
they were established, there existed 
no criteria to determine the need for 
or the location of new institutions. 
There was very little by way of long- 
range planning. Many were established 
on the basis of expediency or to per- 
petuate the name of a distinguished 
church, community, or political lead- 
er. Even if criteria for the estab- 
lishment of new institutions had ex- 
isted and even if planning had been 
undertaken, some unfavorable condi- 



tions could not have been foreseen. 

Some of our state institutions, 
once favorably situated with reference 
to their constituencies, now owing to 
population shifts and to new economic 
and transportation developments are 
relatively isolated. They are compel- 
led by circumstances they could not 
foresee to re-evaluate their role and 
to plan the course of their future de- 
velopment. 

But a college or university should 
not postpone studying its program and 
operations and its future role until 
compelled to do so by the pressure of 
circumstances. Institutional research 
is too often delayed until it is pre- 
cipitated by a crisis. Then conditions 
become so complicated that the diffi- 
culty of developing a research design 
and of executing the research may be 
greatly increased. Some reasons for 
postponing institutional research or 
giving it a low priority as a basis for 
long-range planning are: 

(a) Administration is a continuing 
process of decision-making. 
Decisions that must be made day 
by day are so pressing that the 
administrator finds little time 
to consider long-range planning 
and the studies that are needed 
for planning. 
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(b) The administrator lacks a clear 
conception of the values inher- 
ent in institutional studies. 

(c) Financial limitations force the 
institutional studies into a 
low priority position in the 
operating budget. 

In a word, the administrative cli- 
mate in many colleges and some univer- 
sities is not conducive to the conduct 
of institutional studies. Increases 
in faculty salaries, pressing library 
needs, maintenance and improvement of 
physical facilities — these are immedi- 
ate and dramatic. To divert funds from 
them to studies that appear to be con- 
cerned with more remote needs is a 
difficult decision for an administrator 
to make. 

Assuming that a climate favorable 
to institi.tional studies exists, what 
studies should be promoted and by 
whom should they be made? This is 
the question to which I wish to give 
primary consideration. When I review 
reports of conferences and institutes 
on institutional research, I am im- 
pressed with the recurrence of the 
same topics — faculty and faculty 
loads, students, enrollment projec- 
tions, space utilization, and finance. 

I wish to highlight a few areas in 
addition to thest that are basic to 
institutional planning. They are cast 
in the pattern of a large public uni- 
versity but with some adaptation they 
may be quite as relevant to other 
types of institutions. 

The Role of the University 

Institutions are becoming more and 
more concerned about defining clearly 
their objectives and stating in what 
respects each institution has distinc- 
tive functions and characteristics. 

The printed statements that appear in 
college catalogs and brochures are 
more often a product of creative imag- 
ination than of institutional research, 
a fact that emphasizes the need for 
realistic research related to objer- 



Our society tends to be more dy- 
namic and changing than are the higiier 
educational institutions that profe ^s 
to serve its needs. It becomes imper- 
ative, therefore, as a first step to 
identify changing social needs and 
their implications for each higher in- 
stitution. How do these changes affect 
<'itizenship responsibilities; compe- 
tences in leadership; competences in 
specific professions? What are the 
implications for institutional objec- 
tives and new program emphases of the 
role of our nation in world affairs? 

Is social change progressing at such 
a pace that knowledge and skills ac- 
quired in our colleges and universi- 
ties are out of date before they can 
be applied? If so, each college and 
university must rethink its major cur- 
ricular emphases and perhaps retreat 
from training in skills and technique 
to processes of logical thinking and 
analysis and understandings of basic 
principles and their application. 

A specific illustration relevant 
to this point recently came to my at- 
tention. I quote it without identify- 
ing persons or the institution. In a 
university noted for its research in 
many disciplines, a professor of chem- 
istry in a first course for undergrad- 
uates postponed his scheduled lecture 
and talked instead about the "noole 
gases" so called in the belief that 
they do not enter into compounds with 
other substances. The reason: only 

two days previously a report from a 
science research laboratory of the uni- 
versity reported the union of a "noble" 
gas with fluorine to form a new com- 
pound. These students getting tlioir 
first insights into the intricacies 
of chemical compounds "live on the 
leading edge of today's explosion of 
knowledge." How important it is that 
students live on the "leading edge" of 
exploding knowledge in all fields. 

This can be achieved only when objec- 
tives and programs are in step with 
the march of new knowledge. 

Social change is but one factor 
bearing on the determination of the 
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role of a university. Each institu- 
tion has its own constituency. It 
must know as precisely as possible 
what that constituency is, what its 
special needs are, what image the 
constituency has of the institution, 
and the extent to which the institu- 
tion is serving the needs of its con- 
stituency. For example, one public 
university enrolls a large percentage 
of students from other states many of 
whom come from well-to-do families of 
high social prestige; another enrolls 
a large percentage of students from 
homes of limited financial and cul- 
tural status; still another enrolls 
more than the usual percentage of 
students who have a particular reli- 
gious background. This relationship 
to a constituency is important in 
junior colleges, state colleges and 
ani\rersities, and land-grant ccl- 
legeo and universities. 

Moreover, too often institutional 
objectives are printed for the infor- 
mation of prospective students and 
interested constituents without being 
translated into meaningful terms of 
student growth. Objectives are impor- 
tant to the degree that they are re- 
flected in the educational program and 
ultimately in student achievement. 

VHiat changes in a student’s knowledge, 
ability to think, skills and personal 
traits are expected to take place be- 
tween the time he enters and the time 
he leaves? What measures or ii.dices 
are used to determine the extent to 
which these changes have actually oc- 
curred? What kinds of educational 
experience contribute most effectively 
to the achievement of these objectives? 
Course examinations may disclose what 
a student knows in terms of what his 
teacher expects him to know; but does 
what he knows in history, for example, 
enable him to see world situations in 
a new perspective? Does :.t give him 
^ sense of the currents and counter- 
currents in the flow of history since 
the days of Adam and Eve? 

Objectives, programs related to 



objectives, the measurement of student 
achievements in terms of objectives; 
these are all involved in this much 
needed area of research. 

Q uality 

Much is said about the erosion of 
quality in higher education. There 
are no well established indices of 
quality, nor are there demonstrable 
evidences of the nature and extent of 
its erosion. The evidences of erosion 
of a landscape are ravines washed into 
hillsides, sediment carried in streams, 
and sediment deposits along flood plains. 
Are there analogous signs of erosion of 
quality in our state universities? We 
cite the declining number of Ph.D.’s 
on the faculty, the poor preparation 
of high school graduates, and costs 
rising faster than income in support 
of the contention that the quality of 
higher education is in jeopardy. There 
is also cause for concern about quality 
in the horizontal extension of institu- 
tional programs to bases around the 
world, and in the vertical development 
of programs at the graduate level by 
institutions that do barely creditable 
undergraduate work. 

In a symposium on Social Ghange and 
the College Student^ held only a few 
years ago, one participant made these 
observations: 

As we keep a larger and larger 
proportion of all students in 
school until they are sixteen, 
seventeen or eighteen yea"s old, 
we necessarily lower the average 
scholastic aptitude of the total 
group that we are trying to edu- 
cate, and, except in extraordi- 
narily fortunate and foresighted 
communities, that means a cower- 
ing of the standards of achieve- 
ment required for the high school 
diploma and a consequent postpone- 
ment of certain kinds of learning 
until the college years .... 

It is inevitable that the average 
quality of all American college 
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education will decline as an in- 
creasing pcrcer tage of high school 
graduates seek idmission .... 

As we lower the degree of achieve- 
ment indicated ty the bachelor's 
degree, we can expect more and 
more demand for uasters and doctors 
degrees and a greater tendency to 
postpone until graduate or profes- 
sional school subjects now pre- 
sumed to be suitable for under- 
graduate college. 

Is this an accurate statement of 
current trends in higher education? 

What is the impact of mass education 
in the large university on the quality 
of its programs? Is graduate work, in 
fact, becoming more and more an exten- 
sion of undergraduate education? We 
need objective evidence to support or 
refute the statements that both under- 
graduate and graduate education are 
deteriorating. 

There are offsetting factors to 
these inroads on the quality of higher 
education. Among them are institution- 
al self-studies, rising standards of 
admission, new approaches to teaching, 
and new methods of measuring achieve- 
ment. Until a university has reliable 
evidence concerning the impact of this 
complex of factors on the quality of 
its programs, it cannot plan intelli- 
gently to improve quality. 

Opportunities and Incentives to Learn 

One of the questions most univer- 
sities cannot answer is what do stu- 
dents learn, how and where? It is 
assumed that the classroom provides 
the setting for learning, that the 
curriculum provides the materials, 
and that the faculty member provides 
the guidance and incentives. How well 
this combination of factors achieves 
its purpose is not always clear. To 
what extent do students have to "un- 
learn" some things before they can 
learn others? What is the psycholog- 
ical effect on the student of this 
"unlearning" experience? Is the cur- 



riculum organized so as to provide a 
coordinated and progressive learning 
experience, or is it merely a collec- 
tion of courses grouped under depart- 
mental labels? What kinds of learning 
opportunities do students experience 
outside of the classroom? Do these 
reinforce classroom learning? Do they 
interfere with it? Or are the two un- 
related? Are there anti-intellectual 
influences on the campus? I need not 
be specific here because we all know 
that they do exist on some campuses. 

But, a] 1 too often, the administration 
is not aware of their existence or ig- 
nores their presence. 

Referring more particularly to the 
teaching- learning process, Siegel and 
Siege 1^ say, "The time is long overdue 
when investigators stop inquiring 
whether one mode of presentation is as 
good as another, and undertake instead, 
investigations of those conditions 
thought to optimize the realization 
of educational objectives under clear- 
ly specified and delineated conditions." 

The same authors cite six classes 
of student oriented criteria as "mean- 
ingful dependent variables" for explor- 
ing the "Instructional Gestalt," In 
summary they are: 

1. Acquisition and retention 
of factual information in the sub- 
ject area. Factual information 
acquired is a criterion of some 
importance in assessing the edu- 
cative impact of a particular 
course, even though it may occupy 
a relatively low position in the 
hierarchy of curricular objectives. 

2. Acquisition and retention 
of concepts and the development of 
problem solving facility in the 
subject area. 

3. Quality of student think - 
ing during the class peri od while 
the presentation is being made or 
the discussion is in progress. 

This is a unique criterion since 
it is obtained ^ situ rather than 
as a post-course measure. 

4. Development of course - 
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related attitudes . These include 
changes in the affective domain de- 
sired as specific outcomes of the 
course under consideration. For 
example, we might anticipate that 
an elementary psychology course 
ought to produce certain attitudes 
concerning the appropriateness of 
scientific method applied to the 
social sciences, the sources of 
international tension, the status 
of psychology as a profession, etc. 

5. Development of curriculum - 
related attitudes . Certain kinds 
of affective development or change 
may be anticipated as a result of 
the total curriculum rather than a 
single course. This development 
may involve changes in the stu- 
dents’ self-perceptions and gen- 
eral approaches to new or unfamil- 
iar circumstances and problems. 

6. Impact of the Gestalt upon 
the students’ out-of-class activi - 
ties . including such behaviors as 
vocational choice, leisure reading, 
etc. 

Values of the Scheme 

The Instructional Gestalt is in- 
tended to be a systematic framework 
for asking useful questions. It has 
considerable potential for helping 
us organize some of the things we 
already know, and generate hypoth- 
eses to fill some of the gaps in 
our knowledge. Most advantageous 
of all, it concentrates our atten- 
tion on the basic teaching- learning 
process by making our concerns more 
pointed and sophisticated when we 
consider such instructional innova- 
tions as television, auto-instruc- 
tional devices, and other products 
of our technological age as well 
as ’’conventional” teaching. 

A matter of primary concern is the 
freedom of the student to learn in a 
way that best fits his abilities and 
interests. We have proceeded as though 
it were axiomatic that a student learns 



best under the regimentation of class 
attendance and at a pace established 
by the rate of progress of his classes. 
So strong is the belief in this regi- 
mented procedure in some institutions 
that a student is penalized for failure 
to conform. This whole philosophy of 
regimentation versus freedom of the 
student to learn by independent study 
or by other means adapted to his abil- 
ities and interests needs to be exam- 
ined. Experiments testing various 
procedures should be conducted and 
measures of non-academic learning 
should be designed. Only Ly such 
means can the validity of the philos- 
ophy of curriculum organization and 
of provisions for learning be tested. 
Only on the basis of objective evi- 
dence can an institution plan to im- 
prove its curriculum and its instruc- 
tional procedures. 

Faculty 

The faculty has been studied from 
a number of angles such as character- 
istics, conditions of service, teach- 
ing loads, scholarly contributions, 
and attitudes. One kind of study is 
badly needed. It pertains to the dif- 
ferentiation of functions on the basis 
of differential competences. For 
years, we have proceeded on the assump- 
tion that faculty members are equally 
competent to perform a variety of ser- 
vices such as lecturing in the class- 
room or on television, conducting class 
discussions, directing independent 
study, or preparing syllabi and exam- 
inations. Recent developments have 
challenged this assumption. Certain 
faculty members, because of their su- 
perior ability to prepare and present 
lectures on television, have been 
given this as their exclusive assign- 
ment. Others have been assigned the 
preparation of programmed learning 
materials, and still others the pre- 
paration of examinations. This begin- 
ning of differentiation of functions 
suggests the need for research to 
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establish criteria by which faculty com- 
petences can be differentiated. Once 
such criteria are established, assign- 
ments can be made in terms of special 
competences to the great benefit of 
the students and of the teacher. 

Effectiveness of Management and 
Operation 

The effectiveness of institutional 
management and operation comprehends a 
wide range of activities. It relates 
to the plan of administrative organi- 
zation and the allocation of admini- 
strative functions among staff members; 
provisions for faculty participation 
in planning and operation; plans for 
faculty expansion and development; 
the maintenance of effective communi- 
cations among the staff and between 
the staff and both faculty and stu- 
dents; the organization of plans for 
the expansion and development of 
physical facilities; and the whole 
gamut of fiscal operations. 

In fact, if one looks at this com- 
plex of administration, it seems clear 
tiiat ^or purposes of institutional re- 
search it must be broken down into a 
number of subdivisions such as: cen- 

tral administration, faculty organiza- 
tion, management and planning of physi- 
cal facilities, and financial manage- 
ment. Two of these phases of manage- 
ment — physical facilities and finance — 
have already been the subject of rather 
extensive studies. Our concern, at 
this point, is the central administra- 
tion. 

In studies and evaluation of man- 
agement, business and industry have 
developed highly specialized proce- 
dures. There are, furthermore, con- 
sulting management firms that special- 
ize in the study of the management of 
higher educational institutions. But 
many university ailministrators resist 
the idea of employing the methods of 
business and industry or of employing 
consulting management firms because, 
they say, higher educational institu- 



tions do not fit into a business man- 
agement pattern. They are not oper- 
ated for profit and their materials 
and procesoes cannot be standardized. 
Nevertheless, there is a product in- 
volved and the quality of the product 
is an index of the effectiveness of 
the process. Insofar as the situa- 
tions are analogous, we can take sev- 
eral leaves out of business manage- 
ment's book. 

The real crux of the study of col- 
lege and university administration is 
decision-making. Who makes what deci- 
sions? What authority has he to en- 
force his decisions? What procedures 
are followed and what guiding princi- 
ples, if any, are accepted? What pro- 
visions are made for faculty and stu- 
dent participation? What are the chan 
neis of communication among the staff 
and between the staff and the faculty 
and the students? 

I recently heard it said of a uni- 
versity president, "He certainly plays 
his cards close to his chest. No one 
knows what he is thinking or what he 
will do next until it has happened." 

Of a new president, the remark was 
made, "He brings tLe faculty into ad- 
ministrative matters in a way that his 
predecessor never did. Sometimes I 
think he goes too far in this direc- 
tion. " 

There can be no doubt that admin- 
istrative procedures and their effect- 
iveness reflect personality traits of 
the administrators. We may well ask, 
therefore, is there a combination of 
personality traits that characterizes 
the good administrator? Is there a 
combination of traits that character- 
izes the authoritarian administrator 
and another combination that character 
izes the democratic administrator? 

Does one type of administrator more 
than another achieve efficient opera- 
tion? What is the effect of "effi- 
ciency" on faculty-student morale? 

How can these traits be identified? 

Can they be acquired? How can a know- 
ledge of thes€j traits be used in 
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selecting administrators--in preparing 
individuals for administrative posts? 

These are not new questions as 
they relate to administration in busi- 
ness and industry. They are new, at 
least in their implications for re- 
search, in higher education and to 
some persons they are frightening. 

It should be quite clear that ad- 
ministration is an area of such vital 
importance to the eiiective operation 
of an institution and to the spirit of 
the campus that it should be studied 
in depth. 

The University Consnunity 

We often refer to a college or 
university i.n the real sense of the 
term as "a community of scholars." 

The implication is that there are 
certain bonds of intellectual inter- 
ests that unite faculty and students 
in conmon intellectual pursuits. How 
true is this? Has this concept been 
lost in the mass education develop- 
ments? Isn't it more often true that 
there is a wide gap between faculty 
and students? The very necessity of 
required class attendance, of dead- 
lines for papers, of prescribed read- 
ings, and of general regulations govern- 
ing the personal and organized activi- 
ties of students imposed by faculty 
action appears to refute the concept 
of a community of scholars. 

I shall not pursue this topic fur- 
ther. The "Study of Campus Cultures, "3 
a report by the Western Interstate Com- 
mission for Higher Education is such 
an excellent comprehensive treatment 
of the subject that I can do no better 
than to suggest that you read it with 
care. From it and from the "American 
College" you will derive many more 
ideas about studying the campus Univer- 
sity Community than I can possibly pre- 
sent in a paragraph or two. Let me 
caution you, however, that these sources 
will be most helpful in defining terms, 
designing studies, administering stud- 
ies, and interpreting findings but they 



I will not answer the basic questions 
relating to the socio-psychological 
attitudes and behavior patterns that 
determine the spirit of a particular 
university. Also, most studies that 
have been made relate to certain 
phases of the University Conmunityj 
put together, they represent a mosaic 
embodying a variety of elements of the 
community life. A study of a campus 
! community will require the construc- 
tion of a design that includes those 
facets most relevant to the questions 
to be answered. 

General ObservatioitS 

In conclusion, may I make a few 
general observatio’^s. 

1. Studies in the areas I have 
noted will require careful planning. 
This can be done best by a staff per- 
son experienced in the field of insti- 
tutional studies and responsible for 
taking an over-all view of the planning 
needs of the institution. This may 
sound like a platitude. Even so its 
importance is often ignored, 

2. No single institution can un- 
dertake the whole range of research 
problems, important as they are. Some 
arrangement should be devised for a 
division of responsibility among uni- 
versities that have common research 
interests. One institution might con- 
centrate on a study of administration 
with a view to arriving at a method- 
ology that could be used by others; 
another might focus some of its re- 
search efforts on an analysis of fac- 
ulty competences in relation to func- 
tions. Also, some research projects 
are of such a nature that they might 
be conducted on an interinstitutional 
basis. Such a project might be a study 
of the campus cultures, or factors that 
facilitate or detract from the achieve- 
ment of institutional objectives. 

In a number of states central ad- 
ministrative offices are cond-cting 
studies on problems that are of gen- 
eral concern. Among these projects 
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are *’role and scope studies," unit 
cost studies, teaching loads, and 
characteristics of students, to men- 
tion only a few. 

Then, too, centers for the study 
of higher education are in a position 
to make the more sophisticated types 
of studies for which individual in- 
stitutions may have neither the re- 
sources nor the personnel. 

This approach to the allocation 
of research functions would minimise 
duplication and would give the moft 
mileage for the effort involved, 

3, Participation in the develop- 
ment of institutional studies by a 
small advisory committee composed 
chiefly of faculty members will give 
weight to the studies that are design- 
ed and will pave the way for their 
acceptance by the university commu- 
nity, 

4, The services of specialists-- 
for example, sociologists, psycholo- 
gists, statisticians, educationists, 
physicians and psychiatrists, to men- 
tion only a few--will be required, 

A staff director of institutional re- 
search with the help of his advisory 
committee will identify these special- 
ists and will arrange for their parti- 
cipation in the studies. 

Moreover, projects in basic re- 
search are repeatedly conducted by 
specialists on a campus without any 
thought of their relevance to insti- 
tutional planning. In "Bridging the 
Gap Between Basic Research and Educa- 
tion Practice"^ the authors say, with 
special reference to a project sup- 
ported by the U, S, Office of Educa- 
tion, "As the project progr‘'ssed, we 
found that there is already much bas- 
ic research in the behavioral and 
social sciences with potential educa- 
tional value. We found, however, that 
nearly all such materials require a 
great deal of development through ex- 
tension of fundamental insights, fresh 
applications of principles, and spe- 
cific adaptations of procedures, be- 



fore they can be put to use in the 
schools," 

We need only substitute the term 
"universities" for "schools" to give 
this statement full relevance to our 
discussion. It devolves on the Direc- 
tor of Institutional Research, there- 
fore, not only to identify specialists 
who may be involved in his research 
program but to discover basic research 
that by "extension of fundamental in- 
sights, fresh applications of princi- 
ples, and specific adaptations of pro- 
cedures" may be applied to institu- 
tional problems, 

5, The findings of the institu- 
tional research should be presented 
in a clear, succinct, non-technical 
form. Insofar as they have implica- 
tions for planning and action, these 
should be highlighted. It should not 
be assumed, however, that the value of 
the study is to be judged solely by 
its implications for planning. Some 
studies may merely point the way for 
more intensive or longer range stud- 
ies in the area. Others may be in 
the nature of basic research the ap- 
plications of which remain to be 
developed. 

It is obvious that, in making this 
presentation, I have undertaken to 
sketch briefly a number of areas of 
institutional research any one of 
which might be the subject of an ex- 
tensive paper, I have not undertaken 
to cover systematically all of the im- 
portant areas nor have I endeavored to 
analyze each area into the many sub- 
topics or specific projects that it 
comprehends. In fact, what I have 
said may be less appropriate for par- 
ticipants in this forum than for ad- 
ministrators and faculty members with 
whom you plan and conduct institution- 
al research projects, I hope that 
within the limits of time and of my 
competence to deal with the subject I 
may have laid the groundwork for prof- 
itable discussion. 
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THE TOPIC of this seminar seems 
to imply that planning should be 
based, in part at least, on institu- 
tional research .... It logical- 
ly follows that a project looking to- 
ward the planning of the future of an 
institution of higher education might 
be the occasion for some institutional 
research that would not otherwise be 
undertaken .... It is also con- 
ceivable that some insightful research 
into institutional problems might dem- 
onstrate convincingly the need for 
some planning for the future. Enroll- 
ment projections, as a simple example, 
have been known to lead to a decision 
to undertake a comprehensive planning 
project. 

Pressure s toward the Development of 
Long-range Plans in Publicly Control - 
led Colleges and Universities May 
Arise fro m Several Sources 

A. The Legislature or other agen- 
cies of state government may need to 
look at a plan for higher education as 
an integral part of some total plan 
for public services. 
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B. The accrediting agencies have 
been active in suggesting the need for 
long-range plans in well managed in- 
stitutions . 

C. Some of the endowed foundations 
have been interested in seeing the long- 
range plans of an institution applying 
for any kind of a grant. 

D. Members of institutional boards 
of trustees or regents, who are often 
familiar with the long-range plans of 
industrial concerns with which they are 
associated, may suggest the need for 
something similar in the college or 
university. 

E. An astute administration, faced 
by the necessity of many day-to-day de- 
cisions that may have far-reaching ef- 
fects, often desires the guidance that 
a long-range plan can give. 

The Nature of Plannin g 

A. A single institution can seldom 
do any valid planning without taking in- 
to account the probable development of 
other institutions. 

1. This is particularly true 
for publicl> -controlled institu- 
tions, but also for those under 
private control. 

2. For state-controlled insti- 
tutions, the state is the smallest 
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unit that can be effectively used 
for planning purposes. 

a. A master plan for the 
state is a first necessity, 
and the plans of the individual 
publicly-controlled institutions 
must fit into that master plan. 

b. The individual institu- 

tions in the state will have a 
major part to play in preparing 
the master plan for the state's 
higher education, but its final 
approval must be by a jurisdic- 
tion superior to that of any 
one institution, if there is 
more than one publicly-control- 
led institution in the state. 
Examples of such a higher ju- 
risdiction might be: (1) the 

state-wide coordinating agency 
for higher education, if the 
state has such an agency; (2) 
the state legislature or budg- 
et bureau; and (3) a voluntary 
association of the institutions 
affected. 

c. Within the framework 
of a state's master plan there 
should be much room for each 
institution to develop its own 
plan. 

3. In most cases the state it- 
self is too small a unit for an ef- 
fective master plan. 

a. Few states have suffi- 
cient wealth and population to 
afford the offering of a com- 
plete program of higher educa- 
tion within their borders. 

b. Regional cooperation 

in planning seems highly desir- 
able if the widest possible op- 
portunity to students is pro- 
vided at reasonable cost to the 
taxpayers in most of the states. 

c. Some of even the largest 
and wealthiest states have found 
it desirable to cooperate with 
other states in the provision of 
certain highly specialized op- 
portunities for research and 
graduate study. 



4. It is not enough to plan 
in cooperation with the existing 
institutions in the state or re- 
gion, for thought must be given to 
the possibility of new institutions 
being established within the time 
span covered by the plan. 

a. New junior colleges or 
community colleges are being 
established rapidly in a num- 
ber of states. 

b. A few states are es- 
tablishing new four-year degree 
granting colleges and univer- 
sities under public control. 

c. Some new privately con- 
trolled colleges are being es- 
tablished throughout the coun- 
try. 

5. Valid planning for a pub- 
licly controlled institution of 
higher education must take into 
account the probable development 
of the privately controlled insti- 
tutions in the area. When this is 
done, a fundamental question arises 
as to the justifiable spheres of 
activity for publicly and for pri- 
vately controlled institutions. 

a. In some states, the 
point of view seems to prevail 
that the publicly controlled 
institutions perform a residual 
function, i.e., they take care 
of whatever services are neces- 
sary beyond those that the pri- 
vately controlled institutions 
are willing and able to under- 
take in adequate volume. For 
example: (1) quite commonly 

the privately controlled in- 
stitutions are not much in- 
terested in preparing teachers 
for the elementary schools, 
so the state has assumed the 
responsibility of establish- 
ing normal schools and teachers 
colleges; and (2) there seems 
always to be a "residual" 
function of supplying educa- 
tion of good quality at low 
cost to the student. 
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b. In other states, the 

opposite point of view seems 
to be held; that is, that the 
publicly controlled institu- 
tions have basic responsibil- 
ity for the entire range of 
higher education, with the 
privately controlled colleges 
and universities offering a 
few services or attractions 
that the publicly controlled 
institutions can not or do not 
provide. Examples of such ser- 
vices or attractions are: a 

religious atmosphere, curric- 
ulums preparing for church- 
related vocations, small size 
of enrollment, and highly 
selected student body. 

c. In still other states, 
there is .a rather effective 
balance of influence in the 
choice of programs and services, 
with the publicly controlled 
institutions agreeing to stay 
out of certain areas that are 
served by privately controlled 
colleges and universities, and 
the privately controlled insti- 
tutions, in turn, happy to see 
those under public control take 
over the job of mass production 
in higher education. 

d. The present situation 
and future trends in the rela- 
tionship between the publicly 
and privately controlled in- 
stitutions in a given state is 
a factor that must be taken in- 
to account in the planning that 
goes on in the publicly control- 
led institutions. 

B. A second feature of institution- 
al planning is that it is always based 
on certain assumptions. 

1. It is of prime importance 
that all the assumptions be set 
forth clearly and kept in mind by 
all who are participating in the 
planning. 

2. On many points on which as- 
sumptions must be made the planners 



face not just a dichotomy (that is. 
a yes-or-no or a will-or-will-not 
proposition) , but rather a consid- 
erable range of possibilities. 

a. A good example is the 
assumption about future enroll- 
ments. It is not just a matter 
of whether they will or will 
not increase, but rather of how 
much they will increase. 

b. Forecasts in the en- 

rollment area must be based on 
a combination of facts and 
further estimates or assump- 
tions, such as: (1) the number 

of high school graduates in 
future years; (2) the percent- 
age of high school graduates 
who will go on to college; (3) 
the percentage of high school 
graduates going on to college 
who will come to this institu- 
tion; and (4) the retention 
rates through to graduation 
for those who will enter this 
institution. 

c. Under such conditions 
it is wise to make more than 
one plan, each plan being based 
on some significant variation 
in the basic assumptions, 

3. The assumptions should be 
as complete as possible, 

a. Even if the assumption 
is made that there will be no 
change in a particular situa- 
tion or factor, this should be 
set down explicitly, and de- 
fended. 

b. As a matter of fact, 
one of the most hazardous of 
all assumptions is that there 
will be no chang-*, for in times 
like these it seems that few 
features of higher education 
are likely to remain static. 

c. There should be one or 
more explicit assumptions for 
every variable that goes into 
the forecast. 

C. A third feature of planning 
concerns the length of time for which 
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the forecast extends, 

1. A generation ago we 
thought we had come a long way 
when institutions were induced 
to plan budgets on an annual ba- 
sis, looking a whole year ahead. 

2. Currently the emphasis is 
on planning for a lO-year span in 
the future, 

a. To some extent the use 
of this lO-year time-span seems 
to have been influenced by sug- 
gestions from staff members of 
the Ford Foundation, 

b. Curiously, also, this 
is about the average expected 
span of tenure for a new presi- 
dent in a college or univer- 
sity. 

3. For many institutions, one 
of the most significant variables 
for future planning is the enroll- 
ment. The population group from 
which future enrollments will be 
drawn can be forecast reasonably 
accurately for about 20 years in 
the future, for at any one time 
nearly all who will be entering 

as freshmen for the next 18 years 
have already been born. This fact 
suggests that there might well be 
some experimentation with 20-year 
forecasts. In New Mexico, we did 
a little forecasting on a 15-year 
basis, 

D. A fourth question in institu- 
tional planning is: ”Who is to do it?" 

Two rather different answers to this 
question are found in practice. 

1. Under one arrangement, the 
planning is the work of a few top- 
level administrative staff members, 
a. In extreme cases, the 
president makes the plan all 
by himself. There seems to be 
a tendency: (1) for this meth- 

od to be used when the presen- 
tation of a 10-year plan is a 
practically mandatory part of 
a request to a Foundation for 
a grant or series of grants; 
and (2) for this method to be 



resorted to when the 10-year 
plan is needed in a hurry; 
sometimes the president draws 
it up over night. 

b. Sometimes the planning 
is done by the president and 
the members of his cabinet, 
usually including the academic 
vice president or dean, the 
director of student personnel 
•‘services, the business manager, 
and the director of public re- 
lations , 

c. There is some tendency 
for the planning to be consid- 
ered a primary function of the 
public relations division, or 
the "development office" as it 
may be called. There are cer- 
tain serious disadvantages in 
having the planning function 
assigned solely to the develop- 
ment office. It is pointed out 
that; (1) seldom do the per- 
sonnel in the development of- 
fice have the broad view of the 
entire institution and its prob 
lems that is necessary for ef- 
fective planning; and (2) too 
often the development office 
has its vision limited by its 
ideas regarding the amount of 
money that it will be possible 
to raise. That is, instead of 
first developing a plan for 
what Ought to be done, and then 
looking for ways of obtaining 
the supporting resources, the 
people in financial promotion 
are likely to think first about 
the amount of money that can be 
raised and then proceed to plan 
what might be done within that 
amount of money. It should be 

a fundamental axiom of all in- 
stitutional planning that the 
amount of money that can be 
raised cannot be estimated un- 
til there is a careful analysis 
of needs to determine what the 
money should be used for, 

2. In contrast to the situa- 




RUSSELL 



29 



tion in which the planning is a 
product of deliberations by one 
or a few of the top-level admin- 
istrative officers, is the situa- 
tion in which the organization 
for planning is based on a broad 
involvement of the many kinds of 
people whose interests are af- 
fected, 

a. Several kinds par- 
ticipants may be represented 
in the planning group, such as: 
(1) the board of trustees or 
regents; (2) the administrative 
staff; (3) the faculty; (4) the 
students; (5) the alumni; (6) 
the citizens of the local com- 
_unity; and (7) the state gov- 
ernment (e.g,, one or more mem- 
bers of the Legislature), 

b. The organization under 

this arrangement is usually 
structured in committee form 
so that: (1) there will be a 

series of committees, or sub- 
committees, each dealing with 
some one aspect of the plan- 
ning, such as enrollment fore- 
casts, institutional purposes, 
curriculums, faculty, physical 
plant needs, etc,; (2) there 
will be a central coordinating 
committee, probably comprised 
mainly of the chairmen of the 
various sub-committees; and 

(3) the chairman of the central 
coordinating committee has a 
very important responsibility 
in (a) keeping the sub-coramit- 
tees moving along in their 
work, so that their decisions 
are available as needed in 
other parts of the planning, 
and (b) usually pulling the 
whole thing together at the 
end into some kind of a final 
report, 

c. The arrangement for wide 
involvement of many people in 
the planning has the disadvan- 
tage of producing results rather 
slowly. At the very minimum. 



at least a year, and prefer- 
ably two years, will be re- 
quired to produce a good plan 
by this method, in contrast to 
the few hours of work that a 
president might need to do it 
by himself, 

d. The great advantage of 
the committee method is that, 
when the plan is finally for- 
mulated, it is widely under- 
stood and accepted. It is 
”our*‘ plan, not **his'* plan or 
”theij” plan. Details of the 
plan can be put into effect 
rather readily, 

3, Under any arrangement for 
developing a long-range plan, it 
is often wise to bring in one or 
more outside consultants for ad- 
vice on particular problems, 

E, Another feature of the long- 
range plan for a college or university 
is the fact that it tends finally to 
be expressed in terms of finance or 
budget, 

1, Sometimes it is simply re- 
ferred to as the 10-year budget, 

2, The feasibility of most of 
the features of a long-range plan 
must finally be tested by the abil- 
ity to work them into a balanced 
budget, 

3, This feature of a long- 
range plan has important implica- 
tions for institutional research, 
for it usually means that there 
must be careful studies of the 
probable costs of projected pro- 
grams and policies, 

F, Finally, ^cjith respect to plan- 
ning, it must be remembered that a plan, 
even the most perfect one imaginable, 

is still only a plan. It need not be 
slavishly adhered to when conditions 
change or when important assumptions 
on which it was based prove to be un- 
sound, 

1, Any departure froTu the plan 
must certainly be made very cau- 
tiously, and after full considera- 
tion of the circumstances that seem 
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to warrant such a step, 

2. Some of the features of 
the plan, such as future increases 
ii? average salary of faculty, must 
not be viewed as a definite commit- 
ment, but rather as a goal toward 
whi h the institution is to work. 

3. By the time there have been 
several significant departures from 
the plan, it probably is time to 
make a new long-range plan. 

4. In a time such as the pre- 
sent, when higher education is 
undergoing rapid change and unfore- 
seen situations are arising, a new 
10-year plan will probably be needed 
every five years. 

With this Background Concerning the 
Nature of Institutional Planning . We 
Can Turn to ^ Brief Consideration of 
the Place of Institutional Research 
in the Planning Process. 

A, It is presumed that the insti- 
tutional planning will rest on some kind 
of a factual, objective basis, and that 
it will not be merely the product of 
imagination untrammeled by realities. 

B, The very first requisite is for 
an adequate set of statistics about the 
institution’s past and present opera- 
tions. 

1, These should be available 
for at least 10 years in the past, 
and on some items the time series 
should extend back much further. 

2. Areas in which basic data 
are most urgently needed are: 

a. Enrollments — most 
institutions have reasonably 
good enrollment statistics, 
extending back as far as 
likely will be needed. 

b. Degrees granted — 
these statistics are nearly 
always available and usually 
have a high level of accuracy, 

c. Finance -- annual fi- 
nancial reports are likely to 
be available for a long series 
of years in the past. 



d. Curriculums -- data on 
curriculums are seldom summa- 
rized currently, and any needed 
analysis of past trends in 
courses offered and graduation 
requirements must usually be 
dug out of the file of insti- 
tutional catalogs. 

e. Admission requirements 
and the qualifications of stu- 
dents admitted — quite com- 
monly the statistics in this 
area are scanty for past years; 
some institutions may have data 
for a few recent years on 
trends in test scores for ap- 
plicants admitted. 

f. Library holdings — 
usually the librarian will 
have kept statistics on the 
number of books and periodi- 
cals, and other library data 
will be available for many 
years in the past. 

g. Faculty and other staff 
members — usually the institu- 
tion will not have readily 
available statistics on staff 
members and their qualifica- 
tions for any considerable 
period in the past. 

h. Financial assistance- 
to students — in this area 
also only current data may be 
available, and records for past 
years may not be found in the 
files . 

i. This list could be ex- 
tended almost indefinitely, 
but the examples given are suf- 
ficient to indicate something 
of the scope of the data re- 
quired. 

3. In most cases, the avail- 
able statistics in the files of the 
institution will be found incom- 
plete or unsatisfactory in some or 
many respects, and supplementary 
data must be developed. A few ex- 
amples may be suggested. 

a. Available enrollment 
data may not distinguish be- 
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tween full-time and part-time 
students, and full-time equiva- 
lent enrollment data may never 
have been reported. 

b. Financial data over a 
period of years may not have 
been classified and reported 
consistently in the same cate- 
gories or in accordance with 
standard terminology. 

c. Faculty data are rarely 
reported in terms of full-time 
equivalents. 

d. Data on the qualifica- 
tions of students may have to 
be interpreted into some com- 
mon standard, if different 
measures and tests have been 
applied in past years. 

4. For planning purposes, the 
institutional research office may 
be asked to develop the needed sta- 
tistics, that are not already avail- 
able, concerning institutional oper- 
ations over a period of past years. 

a. Often these have to be 
developed from basic records 
such as old catalogs, financial 
records, board minutes and fac- 
ulty minutes, registrar’s 
records, student personnel 
records, etc. 

b. The development of 
this basic statistical infor- 
mation is hardly a true ’’re- 
search" project; it is merely 
the repair work occasioned by 
lax attention in past years to 
proper statistical reporting. 

c. Many sorts of derived 

statistics may have to be pre- 
pared, if not already available, 
in such areas as: (1) the in- 

structional program — scope of 
course offerings, average size 
of classes, percentage of small 
classes, student-credit-hour 
production per faculty member, 
etc.; (2) unit cost data for 
many different kinds of opera- 
tions; and (3) space utiliza- 
tion data. 



d. The generation of an 
adequate file of statistics 
about the institution may be 
one of the most valuable by- 
products of the planning enter- 
prise. 

C. If the college or university 
has had an effective program of insti- 
tutional research over a period of 
years, many of the studies that have 
been done will likely prove of value 
in the planning process. These com- 
pleted studies should be reviewed in 
order to discover what contributions 
they may make to the problems en- 
countered in the planning. 

D. New studies will doubtless 
have to be undertaken by the office of 
institutional research in order to pro- 
vice information needed in the planning. 
Several types of studies may be in- 
volved, such as: 

1. The systematic collection 
of opinions and attitudes of groups 
affected by the institution's oper- 
ations. 

a. Questionnaire forms 
may have to be developed. 

b. The possibility of IBM 
tabulation must be considered. 

2. The collection of compar- 
able data from similar institutions, 
or from institutions now similar in 
size to what this college or uni- 
versity expects to be in 10 years. 

3. Sound projections of past 
trends. 

4. Evaluative studies compar- 
ing results of different proce- 
dures or methods, e.g., changes in 
admission requirements, or changes 
in policies on instructional loads 
of faculty members, or optimum size 
of enrollment for maximum efficien- 
cy. 

E. The office of institutional re- 
search should serve as a source of ref- 
erence concerning available studies, 
from other institutions, that would 
have a bearing on the planning. 

1. Usually institutional long- 
range plans are not published, but 
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some can be obtained on personal 
request or borrowed, and studied 
with profit. 

2. Some sorts of research 
studies do not need to be repeated 
in every institutional planning 
program. 

a. Examples would be the 
effectiveness of television as 
an instructional medium, or 
the relation of class size to 
student attainment in courses. 

b. The institutional re- 
search office should be famil- 
iar with sources of definitive 
studies on such questions. 

F, The institutional research of- 
fice should be responsible for the de- 



sign of all studies set up in the plan 
ning project, even though some of the 
studies may actually be carried on by 
other agencies in the institution. 

Responsibility of Institutional 
Research Office 

It is my conviction that the in- 
stitutional research office should 
not bear the responsibility of direct- 
ing the long-range planning; instead 
the office should be a facilitating 
agency, helping those that are deeply 
involved in the planning, and seeing 
to it that sound methods and tech- 
niques are used in assembling and in- 
terpreting the data used in planning. 
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INSTITUTIONAL RESEARCH AS A BASIS FOR PLANNING 
LARGE PRIVATELY CONTROLLED INSTITUTIONS 



Stuart Grout 
Director of Institutional Studies 

Boston University 



OUR PURPOSE here today is to focus 
attention on the problems and issues 
associated with the general topic of 
institutional research as a basis for 
planning in large privately controlled 
institutions. This suggests three 
major dimensions which set the limits 
of our discussion. The first is plan- 
ning. What is planning? For our pur- 
poses it will be examined as a major 
aspect of the administrative process. 
Others include organizing, staffing, 
directing, coordination, and control. 
In this context, planning is the 
sketching in broad outline the things 
’ that need to be done and the methods 
for doing them to accomplish the pur- 
pose set for the enterprise. Fayol, 
the famous French industrialist, used 
the term "Pr^voyance,” which means to 
study the future and arrange the plan 
of operations.^- 

Fayol 's "Prevoyance" introduces the 
second dimension of our topic under 
discussion* today. Institutional re- 
search as it relates to planning 
focuses particularly on that part of 
Fayol 's definition of planning deal- 
ing with the study of the future. In 
general terms, "institutional research 
consists of studies and investigations 
focused on current problems and issues 
in institutions of higher education."^ 



It also consists of studies and inves- 
tigations of problems and issues that 
are basic to long-range planning or 
that may ultimately have implications 
for institutional operations.^ It is 
the latter aspect of institutional re- 
search with which we are concerned to- 
day. Planning must be based on facts 
but facts are available only about the 
past and the present, and as every in- 
stitutional research officer knows, 
even these facts prove elusive. Never- 
theless, planning requires a systema- 
tic and comprehensive knowledge of the 
past and present. Planning also re- 
quires a set of assumptions about the 
future. The accuracy of these assump- 
tions in large measure is based upon 
the extent to which they are supported 
and validated by a knowledge of the 
past and present. 

The third and final dimension of 
our topic consists of defining the uni- 
verse or the setting under which plan- 
ning takes place. Our universe is 
limited to large private institutions 
of higher learning. Even so, our uni- 
verse is a large and diverse one. At 
the risk of over-simplification, it is 
useful to formulate the central char- 
acteristics of a theoretical model of 
a large private urban institution. 

1. It is a university, not a col- 
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lege. 

2. It is urban based. 

3. It is located east of the 
Mississippi River and north 
of the Mason-Dixon line. 

4. It has a limited endowment 
and relies on tuition and fees 
to meet the bulk of its general 
and educational expenses. 

5. At one time it was church- 
related^ but its religious ties 
are now loose and in large part 
minor ones. 

6 . It has difficulty plotting its 
future role and direction. 

There is question of whether 
it should limit its enroll- 
ments and strive to upgrade 
the quality of its student 
body or should expand its en- 
rollments to meet the needs of 
the rapidly growing metropoljw • 
tan population. Unlike state 
universities, Ivy League in- 
stitutions, and private liber- 
al arts colleges, it has no 
model of excellence which it 
can strive to imitate. 

7. It is plagued with financial 
difficulties. It faces stiff 
competition for additions to 
its endowment. Even state uni- 
versities are turning increas- 
ingly to non-governmental 
sources for support. Founda- 
tion support is limited largely 
to ’^pump priming" and projects 
of an experimental nature. 
Federal aid will help but may 
not be of sufficient magnitude 
and available soon enough to 
contribute significantly to the 
solution of its immediate fis- 
cal ills. Continued tuition 
increases only compound its 
problems. 

8 . It has a space problem. Its 
urban locale makes land acqui- 
sition and capital construction 
expensive. Thus, it faces im- 
mediately the problem of devis- 
ing ways of developing high 



degrees of space utilization 
under far from ideal condi- 
tions . 

Thus far, an attempt has been made 
to define and delimit the dimensions 
of the topic under discussion. Within 
this framework, let us now turn to 
specific examples of how insti tutional 
research has or can be the basis of 
planning in large private institutions. 

The first illustration is found in 
Exhibit A and is an attempt to suggest 
a format for forecasting soma of the 
problems to be faced by Boston Univer- 
sity during the decade of the 1960 's. 

It was prepared in the Spring and Sum- 
mer of 1960 by the Director of Institu- 
tional Studies for the Vice President 
of Academic Affairs. In addition to 
forecasting the future, the illustra- 
tion suggests steps that might be 
taken to control the future of the 
University through a series of planned 
courses of action based upon more in- 
tensive studies of the enterprise. 

Exhibit B shows a study in depth 
of how to treat one of the problems 
identified in the above illustration. 

It suggests a methodology for increas- 
ing faculty salaries without increas- 
ing total instructional expenditures. 

In Exhibit B, College A serves as an 
illustration of a typical college in 
a large private university. College A]^ 
shows the extent to which faculty 
salaries can be increased by limiting 
the number of associate and full pro- 
fessors to 40 per cent of the total 
instructional staff. In all other 
respects it has exactly the same 
characteristics as College A. Col- 
lege A 2 illustrates the level of fac- 
ulty salaries possible if enrollment 
is increased from 1,500 to 2,000, but 
faculty size and all other characteris- 
tics of College A are heTd constant. 
College A 3 shows the increase in fac- 
ulty salaries possible if the enroll- 
ment is increased by one- third and the 
proportion of senior faculty is held 
to 40 per cent of the total faculty, 
but all other characteristics of Col- 
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lege A are held constant. The three 
variations in the format for College A 
(Ai, A 2 , and A 3 ) all suggest ways of 
increasing faculty salaries at all 
ranks without increasing the total 
budget of the college. College A 3 
shows the greatest increase. For 
example, the mean salary for full 
professors would be $16,002, a $5,565 
increase over the mean salary at the 
full professor level for College A. 
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EXHIBIT A 

BOSTON UNIVERSITY AND ITS FUTURE 
A Profile for the 1960 's 



June, 1960 



le Institutional orientation 



Academic Programs: 
Students : 



Climate: 



Focus on present programs in which substantial and/or 
unique contributions already are being made. 

Major focus on the New England region. Lower ratio 
(necessarily) of commuting students; and higher ratio 
of residential students. 

Urban orientation, emphasis on urban setting and re- 
sources. Meeting needs and drawing upon resources of 
metropolitan area. 



2. Student body 



A projected enrollment by 1969-70 of 12,681 full-time and 11,200 part-time 
students. This represents a full-time increase of 2,241, a part-time increase 
of 3,230. It would mean a total enrollment of 23,881--a full-time equivalent 
of 15,481. A much higher enrollment, and of quality students, could be at- 
tained, particularly in liberal arts programs. But this in turn would requirve 
more physical plant, more faculty, and related costs. This profile study is 
addressed to how we can cope with clearly foreseeable enrollment and costs. 



3. Cap3.tal plan additions firmly planned or contemplated 



Instructional 



Law-Education bldg. 

Library- 

Graduate Center 
CBS (Renovation of MDES bldg.) 
CIT (Sell airport facilities, 
relocate wholly on Charles 
River Campus) 

Medical School Instruf'**. bldg. 



Residential Housing Other 

(self- liquidating) 

For 2500, Charles River Field House 

Campus Student Union 

At Medical Center, for 
400 

Faculty and married student 
apartments, 200 units, 

Charles River Campus 



Enrollment projected ^ .< c.e accommodated in presently planned space (but not 
with presently budgeted faculty) through more effective utilization, issuing 
in part from Schedule Committee and resource utilization studies. 



4. The fiscal problem : a $14,728,000 gap by FY 70? 



While there are other challenging problems, chief of which is continuing to 
improve the quality and conditions of instruction and research, the fiscal 
problem is the over-riding one. The enrollment projected above will require 
an additional (over 1960-61) 110 faculty members, assuming present student- 
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faculty ratio is maintained. Given this size student body for 1969-70, and if 
unrestricted expenditures continue to increase at the same rate as in the past 
five years, the unrestricted budget of the University will by FY 70 total ap- 
proximately $39,000,000. 

Without significant increase in unrestricted income, the gap in 1969-70, be- 
tween unrestricted income and unrestricted expenditures, would be $14,728,000. 
This assumes FY 62 tuition levels, but an enrollment of 15,481 full-time 
equivalent students. 

5. How fill the “gap ”? Various alternatives present themselves. Their com- 
bined use will be necessary. All require careful assessment and planning. 

Among them are the following: 

A» b^^bion increases ? Certainly tuition will need to go up some. But if 
tuition is relied on as the means of filling the gap, the annual tuition 
for FY 70 would have to be $2,000, in contrast with today’s $1,150. 

B. ^ public monies ? 

Boston City ? Entirely improbable . 

States (especially Massachusetts)? Logical but unlikely. But a program 
should be developed and pushed, regionally. On direct state aid, fiscal 
health, church-state factors, etc., make prospect negative. 

Federal ? A strong resource possibility. For example, if HR 7215 (which 
includes one-third matching grants for academic facilities, and loan 
provisions also) is enacted, it could mean that the University’s budget 
allocation of $1,000,000 per year for help in high-rise construction and 
other plant needs could be redirected toward helping meet the gap. 

C. B^ alumni and other private giving ? It is to be hoped a substantial in- 
crease will be seen in the 60 's. Prediction difficult. 

D. ^ internal reassessment and retrenchment ? Hard as it is to face up to, 
this represents one of the major resources in helping to meet the gap. 

It requires comprehensive, sympathetic and telling review of the alloca- 
tion across the University of presently available funds and, where war- 
ranted, a revision in allocations to insure optimum effectiveness in 
terms of the University's major objectives. 

6. General funding plan 

Table No. 1 attempts to rough out a translation of some of the actions suggested 
above into a working plan. It is an illustration only and needs adjustment, re- 
finement. Useful in this planning would be adoption of general guidelines, for 
example: 



-Budget income and expenses from same point of view - BU educational objectives. 
-Devote any tuition increases to faculty salaries and academic programs. 

-On general compensation increases, explore channeling some into non-taxable 
benefits. 
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EXHIBIT B 

THE EFFECT OF FACTORS OF STUDENT- FACULTY RATIO AND FACULTY RANK 

ON FACULTY SALARY SCHEDULES 

COLLEGE ’-A" 

Enrollment: 1300 full-time (or equivalent) students 

Income; $1,500,000 (allowing for scholarships, tuition remission, etc.' 

Faculty: 100 full-time (or equi\^alent) in all ranks 

Faculty-student ratio: 15 to 1 

Allowing 40% income for University overhead: building, central administration, 

etc., the budget allowance for College "A” would be $900,000 ($1 ,500,000-$600,000) . 

this amount, $800,000 is available for faculty salaries. (This college is neither 
subsidized or subsidizes other schools and colleges in the University.) 



Tch.Fell. ,etc. Instr. Asst. Prof. Assoc. Prof. Professors Total 



Full-time Equiv. 


10 


10 


Percentage 


10% 


10% 


Salary ratio 


1 


1 1/3 


Total units 
per rank 


10 


13.33 


Average salary 


$4,175 


$4,567 



20 


30 


30 


100 


20% 


30% 


30% 


100% 


1 2/3 


2 


2 1/2 




33.33 


60 


75 


191.66 


$6,959 


$8,350 


$10,437 





COLLEGE "A^" 

1500 full-time (or equivalent) students 

$1,500,000 (allowing for scholarships, tuition remission, etc.) 
100 full-time (or equivalent) in all ranks 
Faculty-student ratio: 15 to 1 

Allowing 40% of income for University overhead: building, central administration, 

etc., the budget allowance for College would be $900,000 ($l,500,000-$600,000) . 

Of this amount, $800,000 is available for faculty salaries. (This college is neither 
subsidized or subsidizes other schools and colleges in the University.) 



Enrollment: 

Income: 

Faculty: 





Tch.Fell. ,etc. 


Instr. 


Full-time Equiv. 


15 


25 


Percentage 


15% 


25% 


Salary ratio 


1 


1 1/2 


Total units 
per rank 


15 


37.5 


Average salary 


$4,444 


$6,666 



Asst. Prof . 


Assoc. Prof . 


Professors 


Total 


20 


20 


20 


100 


20% 


20% 


20% 


100% 


2 


2 1/2 


3 




40 


50 


60 


202.5 


$8,888 


$11,110 


$13,332 
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COLLEGE "A 2 " 



Enrollment: 

Income: 

Faculty: 

Faculty-student ratio: 



2000 full-time (or equivalent) students. 

$ 2 , 000,000 (allowing for scholarships, tuition remission, 
100 full-time (or equivalent) in all ranks 



20 to 1 



etc.) 



Allowing 40% of income for University overhead: building, central administration, 

etc., the budget allowance for College "A^" would be $1,200,000 ($2,000,000-$800,000) . 
Of this amount, $1,080,000 is available for faculty salaries. (This college is neither 
subsidized or subsidizes other schools and colleges in the University.) 



Tch. Fell. .etc. Instr. Asst. Prof. Assoc. Prof. Professors Total 



Full-time Equiv. 


10 


10 


Percentage 


10 % 


10 % 


Salary ratio 


1 


1 1/3 


Total units 
per rank 


10 


13.33 


Average salary 


$5,635 


$7,513 



20 


30 


30 


100 


20 % 


30% 


30% 


100 % 


1 2/3 


2 


2 1/2 




33.33 


60 


75 


191.66 


$9,391 


$11,270 


$14,087 





COLLEGE "A 3 " 

Enrollment: 2000 full-time (or equivalent) students 

Income: $2,000,000 (allowing for scholarships, tuition remission, etc.) 

Faculty: 100 full-time (or equivalent) in all ranks 

Faculty-student ratio: 20 to 1 

Allowing 40% of income for University overhead, building, central administration, 
etc., the budget allowance for College "A 3 " would be $1,200,000 ($2,000,000-$800,000) . 
Of this amount, $1,080,000 is available for faculty salaries. (This college is neither 
subsidized or subsidizes other schools and colleges in the University.) 





Tch. Fell. ,etc. 


Ins tr. 


Asst. Prof . 


Assoc. Prof . 


Professors 


Total 


Full-time Equiv. 


15 


25 


20 


20 


20 


100 


Percentage 


15% 


25% 


20 % 


20 % 


20 % 


100 % 


Salary ratio 


1 


1 1/2 


2 


2 1/2 


3 




Total units 
per rank 


15 


37.5 


40 


50 


60 


202.5 


Average salary 


$5,334 


$ 8,001 


$ 10,668 


$13,335 


$16,002 





NATIONAL INSTITUTIONAL RESEARCH FORUM 



INSTITUTIONAL RESEARCH AS A BASIS FOR PLANNING: 
SMALL PRIVATELY CONTROLLED INSTITUTIONS 



THE TOPIC of this session, ’’Institu- 
tional Research as a Basis for Planning: 
Small Privately Controlled Institutions,” 
suggests at least three different sub- 
topics: (1) the present status and con- 

dition of institutional research in this 
country, (2) the role of institutional 
research in planning, and (3) the ways 
in which institutional research may be 
different in institutions that are 
small and private. In my presentation 
this morning, I propose to deal with 
each of these, but I will try to give 
emphasis to the third. We will hear 
a good deal in the next two days about 
institutional research in general and 
about a number of specific functional 
topics which are the subject cf insti- 
tutional research, but this session 
and the ’’clinic” on Tuesday afternoon 
will be our only opportunities to con- 
sider the ways in which institutional 
research in small private Institutions 
may hctve itr o\m peculiar problems or 
potentialities. Therefore, I think we 
should take full advantage of the time 
we have this morning to concentrate on 
that specific topic. 

C_ Trent Status of I ns titutional 
Research 

First, I wil] comment briefly on 
the current status of institutional 
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research in general. Institutional re- 
search is a new field which has had a 
remarkable growth during the 1950 's 
and early 1960 ’s. To my mind it is ap- 
proaching the first stages of profes- 
sionalization. My reasons for assert- 
ing this are that we are beginning to 
see a group of people who identify them- 
selves rather self-consciously as in- 
stitutional research officers and who 
identify themselves only secondarily 
with whatever disciplinary fields they 
came from originally. Other reasons 
for thinking that institutional re- 
search is in the early stages of pro- 
fessionalization are that we are begin- 
ning to see a body of literature on the 
subject, a generally accepted group of 
’’core functions” and an accepted method- 
ology for carrying out some of these 
functions . 

Institutional research has a long 
way to go before it can call itself a 
fully developed profession (or sub- 
profession) but it has arrived at a 
first plateau along the way. From that 
first plateau, one can look back and 
see the ground that already has been 
covered. I think that the biggest ac- 
complishment is that methodology has 
been devised and dioseminated for col- 
lecting a good deal of the most basic 
kind of planning and management data. 

In many colleges, this whole process 
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has been sufficiently institutional- 
ized that it now proceeds without much 
fuss or bother. I am referring to the 
collection and analysis of basic infor- 
motion about student enrollments and 
the projection of student enrollments, 

• p.ice utilization, faculty load, in- 
stitutional production in such terms 
as student-credit-hours, unit costs, 
etc. I am not implying that all of' 
the methodological questions have oeen 
solved in these areas, nor do I mean 
that all or even most American col- 
leges systematically collect and ana- 
lyze this kind of information. I do 
mean, however, that a basic literature 
concerning each of these areas exists 
and that there is a systematic proce- 
dure for dealing with many of them 
which is followed in a substantial 
number of institutions. Therefore, 
these are no longer "frontier" areas. 
Institutions which are just beginning 
studies in these areas today do not 
find it necessary to devise their own 
methodology but instead can refer 
either to the literature or to an ex- 
perienced institutional research offi- 
cer to learn an established methodology. 

Several other areas are beginning 
to gain acceptance as appropriate top- 
ics for institutional research. These 
inel:*de the study of students, in 
which a good deal of work has been 
done recently; the study of the con- 
stituency which individual colleges 
serve or might serve; and the study 
->r over-all collegiate environments, 
usually referred to as the college 
v.iimate. There even has been a be- 
ginning at the systematic study of 
the faculty. 

As the field of institutional re- 
search leaves its infancy and begins 
to develop and mature, the differen- 
tiation becomes clearer between insti- 
tutional research on the one hand and 
the more general study of higher educa- 
tion as a social institution on the 
other. The key basis for dis^’inguish- 
ing between the two relates to the 
purpose for which the research is 



undertaken. Academic res«.‘ u . h aboul 
higher education is basic ii search and 
serves the same purpose as do- s all 
other academic research — it increases 
man's knowledge about himself and the 
world, physical and societal, in which 
he lives. It may be carried on in 
academic departments like sociology, 
psychology, economics or political 
science, or in one of the new inter- 
disciplinary centers for the study of 
higher education such as those at 
Berkeley, Ann Arbor, and Teachers Col- 
lege. 

The outstanding characteristic of 
academic research about higher educa- 
tion is that it is done primarily for 
the purpose of learning more about one 
of man's important social activities 
rather than to help solve the adminis- 
trative or managerial j)rublems of any 
one particular college or university. 
Institutional research, on the other 
hand, is applied research. It is an 
administrative tool. It assists the 
decision-makers within a particular 
college or university to do their jobs 
more effectively because it provides 
them with information which is directly 
relevant to the particular problems 
which they face. The line between ap- 
plied research and basic research ad- 
mittedly is fuzzy; but if one looks, 
not at the borderline cases, but at 
the extremes, it is readily apparent 
that the distinction is real. Institu- 
tii^ 1 research and academic research 
about higher education are like first 
cousins; they are different but related. 

Having suggested this distinction 
between institutional research and 
academic research, two further com- 
ments may be in order. One. is that 
this distinction between the two 
does not mean that there v^ill be no 
overlap. Some of the basic contribu- 
tions to our knowledge about the higher 
education enterprise nay be made on 
occasion by offices of institutional 
research and, by the same token, aca- 
demic departments within an institution 
may from time to time be willing and 
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ibb* to make significant contributions 
iv' ^.ampu.' projects which are essential- 
ly institutional research. 

The Second comment has to do with 
the institutional research officer him- 
self. The institutional research offi- 
cer, especially if he is good, cannot 
avoid being half fish and half fowl — 
that is, half administrator and half 
faculty member. This grows out of the 
requirements of the job itself. An 
institutional research officer must 
have certain of the attributes of a 
good faculty member such as a catholic 
curiosity, a good imagination, and a 
respect for thoroughness. He must also 
have certain of the attributes of a 
good administrator, including a belief 
that knowledge is most valuable when 
it can be applied in a meaningful way 
and the ability to identify those 
problems which at the moment are sus- 
ceptible to treatment. The fact that 
the institutional research officer is 
a hybrid often will be annoying both 
to administrators and to faculty mem- 
bers, but it is precisely the thing 
that makes him valuable to the insti- 
tution, One device for alleviating 
this fish or fowl dilemma is the use 
of an advisory committee on institu- 
tional research which is made up of 
both faculty and administrative rep- 
resentatives. Such a committee also 
can be the source of some excellent 
guidance and advice for the institu- 
tional research office. 

Role of Institutional Research in 
P lanning 

My general comments about the 
second sub-topic — the role of ir-stitu- 
tional research in planning — will be 
brief, but I will come back to this 
topic later as it relates specifically 
to institutional research in small in- 
stitutions. In general, I think it is 
sufficient before a group like this 
simply to assert that, due to such 
factors as rising enrollments, rising 
costs, and the explosion of knowledge, 



our colleges are under greater pressure 
than they have ever been before in their 
history. This fact makes effective in- 
stitutional planning an absolute neces- 
sity. Effective planning cannot be 
done without information, and the task 
of the institutional research office is 
to provide the needed information. 

An institutional research office 
must gather, analyze, and interpret 
basic information about the institution 
in which it is located, T.i order for 
this information to be really meaning- 
ful, the institutional research office 
also must have normative data in the 
form of information about other insti- 
tutions and about national and regional 
averages. The subjects about which an 
institutional research office must pro- 
vide information are extremely varied 
and include collegiate organization and 
management, curriculum, faculty, stu- 
dents, physical facilities, and the 
constituency which the institution 
serves. 

The simple recitation of subjects 
about which information must be gath- 
ered indicates the size of the task. 

In any institution, large or small, it 
can be accomplished only by taking full 
advantage of every possible legitimate 
short-cut. Whenever possible, the in- 
stitutional research office must take 
advantage of the information already 
being collected by other administrative 
offices on the campus, and when new 
types of information are to be gathered, 
this needs to be done in such a way that 
it can also serve the needs of other 
college offices. For example, infor- 
mation about students and student 
credits can be gathered cooperatively 
with the registrar; information about 
faculty and faculty loads can be gath- 
ered jointly with the dean. 

The institutional research officer 
also must conserve his own time and 
energy by making full use of the work 
done by people in other institutions 
who are studying higher educatioji, es- 
pecially other institutional research 
officers. From them, he can learn a 
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great dt-.il that will help him decide 
which studies he can most profitably 
undertake in his own institution, how 
much time and effort they may require, 
and even the methodology which should 
be followed to produce the best infor- 
mation with the least effort. For ex- 
ample, it is a complete waste of tine 
for an institutional research officer 
to ignore the literature and devise 
for himseif a procedure for making a 
space utilization study or a faculty 
load study. Others already have made 
many of the mistakes, and on the basis 
of that experience devised several 
alternative methodologies and put 
these into the literature. An insti- 
tutional research officer would be 
justified in working on new procedures 
in these areas only if, after becoming 
familiar with the existing literature, 
he thinks he can improve upon these 
procedures or develop better ones. 

One further short-cut involves the 
identification of studies which do 
not need to be replicated on every 
campus. Examples of this which come 
to mind readily are the innum^^rable 
studies of the effect of class size 
on learning. 

Differences in Institutional Research 
in Small Private Colleges 

The third sub-topic to which I 
want to give attention, and the one 
which I consider most pertinent to 
this morning's session, is the way 
in which institutional research may 
be different in a college which is 
small and private. I think there are 
a number of ways in which institution- 
al research in small private institu- 
tions is different from institutional 
research in pther institutions. Some 
of these differences are, at least 
potentially, advantages and some are 
disadvantages . The fact that these 
differences exist does not mean that 
institutional res'^arch in small private 
institutions is outside the main stream 
of institutional research per se ; never- 



theless, they ar«^ important enough 
that an awareness of them is esseiULal 
if a significanc institutional research 
job is to be done in small private in- 
stitutions. 

Lest there be any misunderstanding . 
let me preface my remarks about the 
factors which differentiate small pri- 
vate institutions from other colleges 
and universities by saying that I do 
not think all small private institu- 
tions are alike. We are plagued by 
stereotypes and cliches about small 
colleges, some of which suggest that 
these institutions are necessarily 
good and some suggesting the opposit.-. 
The simple fact is that there are a;- 
proximate ly 1,250 colleges in the Uniitu 
States which have an enrollment of less 
than 1,000 students. This is over bO 
per cent of the total number of col- 
leges and universities in the country. 
The diversity among small institutions 
orobably is greater than among any 
other single classification. Any pub- 
lic relations officer who tries to sell 
the idea that a small college is ipso 
facto a good college is engaging in 
charlatanism and, by the same token, 
anyone who assumes that a small insti- 
tution necessarily is inferior is suf- 
ficiently uninformed to have earned 
the label "stupid.'' 

Despite their diversity, however, 
small colleges share certain charac- 
teristics which, on the one hand, open 
to them certain possibilities for de- 
velopment and, on the other hand, pre- 
clude certain other possibilities. 

Size of enrollment is the obvious 
way in which small colleges differ from 
other institutions. Less obvious but 
equally significant are the innumerable 
other differences which stem, directly 
or indirectly, from a limited enroll- 
ment. It limits the number of classes 
that can be offered, and indirectly it 
limits the number of faculty members 
who are employed, the specializations 
of these faculty members, the number 
of administrative staff members and 
their specializations, the number of 



MILLER 



47 



buildings on the campus, the financial 
resources of the college, and, if the 
college has them at all, the size of 
the research program and of the com- 
munity service activities. Not all of 
these limitations are a necessary out- 
growth of a small enrollment, but they 
generally are correlated with it. 

Smallness offers certain opportuni- 
ties and it imposes certain limita- 
tions. Let us look first at the lim- 
itations. A small college does not 
have the resources to offer a wide 
variety of courses and activities 
from which the student may choose — 
at least not in the sense that these 
are available to students in a univr- 
sity. The number of students in a 
small college only can be divided 
among a limited number of separate 
classes before individual class en- 
rollments become too small for effec- 
tive education let alone efficient 
operation. Furthermore, the number 
of faculty members also is limited in 
a small college, and if a large number 
of courses is offered it usually is 
accomplished by overloading this 
limited faculty. The effect of this 
overloading, of course, is to drive 
away the good faculty members who are 
sincerely interested in doing a good 
job of teaching or in using their free 
time for research or writing. Finally, 
the financial resources of most small 
colleges are limited, and it is easy 
for the small college to exhaust most 
of these resources simply in paying 
the costs of teaching a large miscel- 
laneous array of courses. All of this 
suggests that the small college is 
severely limited in what it can under- 
take and, therefore, must plan care- 
fully if it is to be successful. De- 
limitation becomes a necessity--delim- 
itation of purposes, objectives, cur- 
riculum, and staff. 

What are the advantages which 
smallness offers? The mO'='t signifi- 
cant of these is the potential advan- 
tage--! emphasize the word "potential"-- 
of institutional unity. The small 



college has the ability, because of 
its smallness, to decide upon a single 
set of institutional objectives and 
build a total collegiate environment 
which pr'^otes these objectives through 
every facet of a student's life. It 
has become abundantly clear that the 
student learning which takes place on 
a college campus is a result of much 
more than simply the classroom experi- 
ences. The out-of-class experiences 
are equally important, both for what 
they contribute in ana of themselves 
and also for the effect which they 
have on the student's receptivity to 
and use of his classroom experiences. 

A small institution, at least po- 
tentially, has the ability to weld the 
faculty, the administration, and the 
student body into a single, managcabL 
environment, designed to promote the 
particular objectives which the insti- 
tution has adopted as its own. Jacob's 
review of the studies of student values 
indicated that the few colleges in this 
country which have been particularly 
successful in affecting students' 
values, attitudes, and ambitions have 
been small institutions which did pre- 
cisely this. Very few small colleges 
actually have succeeded in creating a 
genuinely distinctive educational en- 
vironment. Nevertheless, the potential 
is there and I would point to it as 
probably the m^^ " Important single ad- 
vantage which a small institution has 
over other institutions. 

A major effort by a college to 
create a unified climate for learning 
of this type involves all phases of 
the college's operation and, therefore, 
it must involve nearly all members of 
the college community. It involves 
basic questions of college organization 
and finance, of curricular content and 
structure, of teaching methods* of 
extracurricular life, of faculty selec- 
tion and development, and of student 
selection (which may be a matter of 
direct selection by the college or of 
student self-selection based upon the 
image which the college creates). Most 



o 

ERIC 




48 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



important of all, it involves questions 
of the institution's basic purposes and 
objectives, although the general campus 
community may come to realize their im- 
portance only after they see some real 
evidence of the immediate relevance of 
the college's stated objectives to some 
of the other areas I have just men- 
tioned. The reason for this is simply 
that most faculty members have never 
worked in a situation where the insti- 
tution's stated purposes and objectives 
had a direct relationship to campus 
decision-making. 

The stated purposes of most Amer- 
ican colleges and universities are suf- 
ficiently vague that the institution's 
real purposes can be determined only 
on a behavioral basis. In most cases 
the average faculty member, administra- 
tor, and even student finds himself in 
a laissez-faire situation where he can 
operate pretty much as he chooses in 
selecting the collegiate purposes and 
objectives he will assume to exist or 
seek to fostei . 

A laissez-faire atmosphere is not 
necessarily bad; it offers many of the 
advantages which are associated with 
freedom and permissiveness. However, 
it also carries with it the disadvan- 
tages associated with a lack of agreed 
purpose and a lack of real planning. 
Each faculty member and student is free 
to assume his own institutional goals 
and do his own work as though these 
were being shared and promoted by the 
rest of the institution, but in fact 
they may not be — a situation which 
results in ineffectiveness and frustra- 
tion. Some institutions would calcu- 
latedly choose a laissez-faire atmos- 
phere as a preferable alternative to 
any planned set of institutional pur- 
poses; but most institutions have not 
chosen to be laissez-faire, they have 
simply drifted into it. Institutional 
purposes and objectives become impor- 
tant if and when a college decides to 
develop a unified educational environ- 
ment designed to produce educational 
outcomes which reflect a set of stated 



institutional purposes and objci livt s. 

The potential ability of a small 
college to shape its own destiny has 
been discussed in several recent and 
important publications. Two of these 
which lay emphasis on the educational 
implications of this question are the 
chapter in Philip Jacob's book on The 
Changing Values in College titled "The 
Peculiar Potency of Some Colleges," 
and the chapter in Edward Eddy's book 
The Col leg< Influence on Student Charac 
ter titled "The Effect of Environment." 
Three others which have stressed the 
economic ntcessity for severely delimit 
ing the stated purposes and objectives 
of a small college and then initiating 
extensive curricular reforms to effec- 
tuate them are the Beardsley Ruml- 
Donald Morrison volume Memo to a Col - 
lege Trustee, Earl McGrath's Memo to £ 
College Faculty Member, and Sidney 
Tickton's writing on A Ten-Year College 
Budget . 

I have emphasized this potential 
ability of small colleges to re-shape 
themselves into institutions with 
sharply delimited objectives and a 
unified educational environment that 
is deliberately designed to carry out 
those objectives because I think an 
increasing number of small colleges, 
especially small private colleges, will 
be moving in that direction in the next 
few years. The institutions that do so 
may never constitute even a majority of 
all the small colleges in the country, 
but if the past is any guide, they will 
constitute the most exciting group of 
small colleges and, therefore, they 
merit special attention. 

Function of Institutional Research 
Offices 

The function of the institutional 
research officer in any institution is 
to collect, analyze, and make available 
information which will assist in the 
effective operation of the college. 

This is true regardless of whether the 
college is engaged in the kind of soul- 
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searching I have been discussing for 
the last few minutes. The kinds of 
information which are most needed at 
any particular time will vary from 
one college to another. In a college 
that is engaged in soul-searching, 
the need probably will be heavier on 
the side of studies of students, edu- 
cational outcomes, and curriculum 
than would be true in other colleges. 
All institutions also need studies of 
space utilization, faculty load, costs 
and other topics related more specif- 
ically to institutional organization 
and management. 

Institutional research in a small 
college is affected by the fact that 
the entire operation •’Imost inevitably 
is small in terms of t,taff and finan- 
cial resources. In almost every case, 
the institutional research officer in 
a small college has come to his posi-' 
tion without previous training or ex- 
perience in institutional research 
and, therefore, he is largely self- 
trained, If that self- training is to 
be good training, he needs a large 
enough budget to assemble a working 
library on the subject, to travel to 
meetings such as this one, and oc- 
casionally to visit other institu- 
tions where projects of interest to 
him are underway. He needs the back- 
ing of the college administration and 
he needs the understanding of the 
faculty. A device which will help 
to gain both is a campus advisory 
committee on institutional research 
representative of both the administra- 
tion and the faculty. He needs ade- 
quate clerical assistance and office 
machinery. And, in a small college, 
it is especially important that the 
institutional research office make 
the fullest possible use of the work 
of others, the talents and interests 
of faculty members within the college 
itself, and the published reports of 
studies done in other institutions. 

In a few situations, it has been 
possible to set up cooperative insti- 
tutional research projects among groups 



of small colleges. This permits the 
colleges, and their institutional re- 
search officers, to divide the work- 
load and, even more important, to 
share ideas, share information, and 
benefit from an interchange among 
peers that is extremely helpful to the 
professional development of each of 
the institutional research officers 
involved. In Alabama, a series of 
such inter-institutional projects was 
developed which centered on Auburn 
University and permitted the cooperat- 
ing small colleges to draw upon the 
university for technical assistance. 
This kind of development seems partic- 
ularly promising. 

In summary, I would say that in- 
stitutional research in its short 
history as an identifiable field of 
specialization has made considerable 
progress. The need for institutional 
research will grow rapidly because the 
pressures of mounting enrollments, 
tighter financing, and the explosion 
of knowledge in our time make institu- 
tional planning an absolute necessity. 
A prerequisite to such planning is 
adequate information, and the collec- 
tion and analysis of such information 
is the function of institutional re- 
search. 

Small colleges have a special need 
for careful planning because of their 
limited number of students and faculty 
and often because of limited finances 
as well. In an increasing number of 
small colleges, the positive side of 
this situation will be emphasized 
through the development of clearly 
delimited programs which are calcu- 
latedly designed to produce education- 
al outcomes more consistent with the 
institution's stated purposes and ob- 
jectives. In those colleges, institu- 
tional research can contribute to the 
development of such programs in the 
same way it contributes to the effec- 
tive management of the institution in 
general — by providing the background 
information which is needed for effec- 
tive decision-making. 
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PRE-ADMISSIONS EVALUATION 

AND COLLEGE SCHOLASTIC PROGRESS PATTERNS 



John R. Hills 
Director of Testing and Guidance 
University System of Georgia 



I AM both honored and pleased to 
be with you this afternoon to talk 
about some of our studies of college 
students. In Georgia we are doing 
some things that do not seem to be too 
common elsewhere. I hope that you and 
the discussants will call to my atten- 
tion new and better procedures for us 
to apply and that you will pinpoint 
still other problems which should no 
longer be overlooked. 

I feel a need to say a little about 
the organization of higher education 
in Georgia in order to provide a con- 
text for my later remarks. All twenty 
publicly-supported institutions of 
higher education ^*n Georgia are organ- 
ized into one University System and are 
controlled by one Board of Regents. 

These are fifteen men, appointed by the 
Governor for staggered seven-year terms 
of office. The Board has a full-time 
staff, including a Director of Testing 
and Guidance with a System-wide respon- 
sibility. 

Included in the twenty institutions 
or units are the University of Georgia 
and Georgia Tech at the university level; 
four fairly standard liberal-arts col- 
leges; a college for women; a military 
college; three Negro liberal-arts col- 
leges; thref. urban, community colleges; 
four rural, residential junior colleges; 



a technical institute; and a medical 
college. Since none of these institu- 
tions has had an active institutional 
research program (except, recently, 
Georgia Tech), the comprehensive study 
of University System students has been 
done in the Regents’ Office of Testing 
and Guidance. One virtue of the central- 
ized organization is the communication 
between units and across the whole State 
that is thereby made possible. 

Just there are two topics in 
the title of this paper, my remarks are 
organized into two parts: (1) Pre- 

Admission Evaluation and (2) Scholastic 
Progress Patterns. Under each topic I 
will emphasize the methods we use, show- 
ing how they sometimes result in findings 
of interest. Since I have gathered that 
you are a sophisticated audience, I will 
assume that you are familiar with the 
common statistical techniques and meth- 
ods. I hope that some of you may have 
procedures to recommend to me which will 
improve on those that we now use. 

Pre-Admission Evaluation 

Turning to the first topic--as i 
think about the evaluation of students 
concerning admission to college, the 
process starts in the high school, if 
not sooner. Whoever counsels with a 
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high school student faces with him the 
question of whether he should go to 
college. In Georgia they tell me that 
years ago a method of vocational coun- 
seling of very young children was per- 
fected. There were not man;, *< oupa- 
tions then, so a simple technique was 
adequate. You placed a young boy into 
a room which had nothing in it but an 
apple, a silver dollar, and a Bible. 

You watched to see what caught the 
boy*s attention. If he picked up the 
dollar, he would be a banker. If he 
went to the apple, h-?' would be a 
farmer. If he showed interest in the 
Bible, he would be a preacher. If he 
sat on the Bible, ate the apple, and 
put the dollar in his pocket, he 
would be a politician. 

Regression Analysis 

It is not so easy any more. Col- 
lege enters the picture, and the stu- 
dent asks, "Which college?" For a 
counselor consistently to supply other 
than misleading information, he has to 
have accurate, current data from the 
colleges. He needs prediction data, 
from multiple regression analysis. If 
you asked me what technique or method 
we rely on most heavily, I would say 
without hesitation that it is some form 
of regression analysis. Basically, we 
analyze the data from the entering 
classes at each institution to deter- 
mine how test scores and school per- 
formance can bebt bt used to predict 
college grades. 

As you can imagine, with a score 
of institutions we do a lot of regres- 
sion analyses each year. For that 
matter, a counselor helping a student 
decide which college to attend has to 
deal with a number of prediction equa- 
tions. So we seek simplicity and ef- 
ficiency. This results in our obtain- 
ing our regression analyses as by- 
products of analyses of covariance, 
rather than directly. You see, we know 
that quite often different prediction 
procedures are necessary at the same 



institution for students of different 
sex. However, sometimes a single re- 
gression system will suffice for both 
sexes. This, then, usually becomeb 
our first question, "Can we use one 
formula for both boys and girls?" 
(Sometimes, as at the University of 
Georgia, for each sex we first ask 
whether the same prediction equation 
can be used regardless of what school 
of :he University a student enters. 
Currently, the answer is that the school 
of entry does not matter for the purpose 
of predicting freshman grades.) 

Analysis of Covariance 

To answer the question about sex 
differences in prediction, we use anal- 
ysis of covariance as formulated by 
Gulliksen and Wilks in their 1950 
Psychometrika article. They provide a 
procedure for evaluating whether the 
same regression obtains in several sam- 
ples. We have a computer program avail- 
able which makes this evaluation, pro- 
vides the relevant regression equation 
or equations, and tests the significance 
of the regression weights. Use of this 
procedure sometimes allows us to com- 
bine sexes. It often allows us to com- 
bine successive classes of entering 
students, but not always. Covariance 
analysis has revealed that size of high 
school is not a significant factor in 
academic success in the first year at 
Georgia Tech, that adjustment of pre- 
dictions according to the particular 
high school from which a student enters 
Columbus College is fruitless, that 
similar adjustments at the Medical Col- 
lege of Georgia are not worth the 
trouble, and so on. This is a very 
handy technique to have at your dis- 
posal. 

S imp 1 i f ica t ions 

T1 test of significance of regres- 
sion weights is a nice feature. We used 
multiple regression analysis a few years 
ago to decide whether we could improve 
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prediction by adding more test scores 
as predictors. Oar basic test scores 
come from the College Board's SAT, a 
Verbal and a Mathematical score. We 
ordinarily get pretty good prediction 
from the SAT and the high school aver- 
age. The multiple correlations for 
the University System average around 
the mid-. 60 's from year to year. How- 
ever, we added the STEP series of 
achievement tests, some of the Cooper- 
ative Achievement Tests, and from time 
to time, a variety of other tests such 
as the Otis and the Bennett, and con- 
sistently we found little improvement 
in prediction accuracy considering 
file time and effort involved. This 
being the case, it was obvious to 
question whether we even needed both 
the V and the M score from the SAT. 

It turns out that often we doi't; often 
the second test score improves the mul- 
tiple correlation by less than .015, an 
arbitrary, practical criterion we used 
before the availability of the current 
analysis of covariance program. So we 
simplify things in another way, by 
omitting predictors which are not con- 
tributing significantly. A two- 
predictor equation is easier for an 
admissions officer, or a counselor, to 
use . 

Counselor ' s Guide to Georgia Colleges 

As I said before, if the counselor 
is to be effective he has to have ac- 
curate information from the colleges. 

The information from a variety of col- 
leges must be transmitted to the coun- 
selors in a form which will permit that 
information to be used in a counseling 
session. The usual prediction formula 
won't do, nor will an unsystematic array 
of data from different colleges. Our 
method for handling this is for one of- 
fice to analyze the data from all the 
colleges in the State, public and pri- 
vate, and to publish them together in 
a common format, distributing the data 
free of charge to all counselors in the 
State. We call the document containing 



these data the Counselor's Guide to 
Georgia Colleges . A page of the Sup - 
p lement to it has been reproduced for 
you in Exhibit A. 

You will see that we have simpli- 
fied the prediction equations in two 
ways. For each of the colleges, in 
Exhibit A, the M score for females did 
not add to prediction accuracy, so it 
was left out. We have also multiplied 
the entire equation through by a con- 
stant so as to have integral weights, 
after rounding. Then we v;ent to the 
probability approach because we tho izht 
it would be the most helpful way for a 
student to consider predictions. It 
keeps the degree of prediction error 
before him, rather than hiding it in a 
predicted average grade. The details 
of conversion from the usual regression 
equation to these simplified equations 
and tables are forthcoming in an article 
in the Personnel and Guidance Journa I . 

Admissions Officers 

The school counselor does not do 
all of the pre-admissions evaluation. 
College admissions officers also have 
their say. Sometimes their problems 
are impossible, as the time when one of 
our admissions officers faced the ador- 
ing mother whose wonderful son had only 
two problems. He just could not do well 
on tests, so his lowly SAT scores should 
be ignored. His only otht*r problem was 
that it made him nervous to study. 

Most of the evaluations that the ad- 
missions officer mu*^t make can bt- handled 
by procedures as simple as those used by 
the counselor. The same simplified equa- 
tions can be used. Their accuracy is 
almost always within one- tenth of a 
letter grade. When only two predictors 
are used, an abac, such as that of Ex- 
hibit B, is very convenient. There you 
merely find the student's high school 
average grade on the vertical axis, fol- 
low it across to his SAT V score on the 
horizontal axis, and read his predicted 
freshman average grade from the diagonal 
lines. In borderline cases, one might 
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want to refer to che full prediction 
equation, but this should involve only 
a small proportion of the applicants. 

Cutoff Scores 

Some of our Georgia admissions of- 
ficers have the annoying problem of 
operating admissions on the basis of 
beds rather than of brains. That is, 
instead of admitting all students who 
can do the work, and no one else, they 
are assigned the task of admitting the 
best available 500, or 200, or whatever 
number the administration prepares for 
in its budget. One way to proceed is 
to take the first 500 who apply. Sven 
then, more than 500 must be admitted 
in order to have 500 register. We 
think that a better procedure than 
first-come, first-served is to esti- 
mate a cutoff predicted grade which 
will yield the desired number of 
bodies by the time classes start. 

This way the most able 500 will be ad- 
mitted instead of just the first 500. 
This procedure also tends to keep the 
admission season open longer. At 
least one Georgia college found one 
year that if it had started its admis- 
sions on the day it close-' them, the 
college could have enrolled a better 
freshman class. There were more supe- 
rior applicants after the beds were 
filled than before. If one wants to 
expend the State's educational re- 
sources on the best available raw 
material, it is poor management to 
turn away good students just because 
they apply in the summer rather than 
in the spring. 

The admission officer's delicate 
balancing must be between having empty 
beds and having beds out in the halls, 
when he knows that not all admitted 
applicants will register. A little 
systematization of the process would 
not hurt. The first step is to keep 
track of applications from year to 
year. This helps one estimate in sub- 
sequent years whether applications are 
coming in at about the same rate as 



previously. (We expect an increase of 
157o between Fall, 1963, and Fall, 1964.) 
The second step is to keep track of the 
predicted grades of each applicant. 

The third step is to note how many of 
the accepted applicants each year actu- 
ally enter. By using a form such as 
Exhibit C, one can determine what per 
cent of applicants to accept to get the 
desired number of entering students. 

From the distributions of predicted 
grades of previous years' applicants, 
one can determine what predicted grade 
falls at the proper percentile point. 

This is a good approximation to a suit- 
able cutoff. 

Scholastic Progress Patterns 

Let's turn to the second topic. 
Scholastic Progress Patterns. 

Counting 

After the student is admitted, what 
happens to him? It is surprising how 
much can be found by as simple a method 
as mere counting. How many students 
graduate four years after being admitted? 
Five years after being admitted? Ever? 
How many change their major or school? 
Which schools do they change from , pre- 
dominantly? Which schools do they 
change j^? How many who take remedial 
courses upon entry ever survive to 
graduate? How many of the borderline 
people, to whom we give a trial, ever 
make it to the cap and gown? 

If you have not tried counting such 
things, you will probably be surprised 
and disappointed at what you find. The 
data I've seen seem to indicate that 
educational institutions are doing a 
lot of remedial wheel spinning. Count- 
ing can correct some of our mistaken 
ideas about college attendance. From 
data I have seen so far in the Univer- 
sity System, ’t is the unusual student 
who enters and attends one college con- 
tinuously during the school year until 
graduation. 
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Significance Tests 

More complex questions require 
more complicated methods. One kind 
of question we ask is whether the 
weaker students tend to be the ones 
who fall by the wayside. At first 
blush that seems like a silly ques- 
tion. But when we look at our data, 
it is not so silly. Sure, the weak 
students drop out, but so do the 
strong^ The class that survives is 
often indistinguishable in academic 
potential from the one that entered. 
But it is so much smaller.' To con- 
vince ourselves about this, we use 
the usual significance tests for dif- 
ferences between means. To convince 
others, we draw graphs showing the 
spread of scores as well as the means. 

Another method We use was pre- 
sented by Thomas A. Ryan in a series 
of articles in the Psychological Bui - 
Jgtin ( 1959 , p. 26 - 47 , 1960 , p. 318 - 
328 , and 1962 , p, 301 - 305 ). The prob- 
lem is that of multiple comparisons. 

If you have a number of statistics to 
compare, such as mean SAT V scores on 
five successive entering classes, or 
on eight different schools within an 
institution, and so on, repeated ap- 
plication of the usual significance 
test at, say, the 57 o level will be 
deceptive. If you were just picking 
'^ut two of the means to be compared 
tor some hypothesis you had in mind, 
the single significance test at the 
.05 level wouid be appropriate. But 
wnen you makt all possible independent 
rc^npar isons, you expect five per cent 
of them to be significant at the .05 
level, i.e.. there is a 50-50 proba- 
bility of getting five significant 
results at the .05 level. To ?et a 
set of data which shows at the .05 
level that something other than chance 
is operating, you must have more than 
five per cent cf the individual signi- 
ficance tests significant at the .05 
level. Ryan describes a general method 
£f adjusted s ignificance levels which 
controls the error r^te experiment- 



wise. That is, we are able to state 
the probability that one or more of 
our conclusions will be incorrect in 
that we falsely claim significant dif- 
ferences. An example of one of our 
computation forms for multiple compar- 
isons of four means is presented in 
Exhibit D. In conjunction with Ryan's 
articles, the use of the form will be 
clear. 

Multiple correlation procedures 
can be used in imaginative ways to 
study the scholastic progress patterns 
of admitted students. Dr. Warren 
Willingham demonstrated at Georgia In- 
stitute of Technology that allowing for 
the trend in a student's grades during 
his first three quarters at Tech did 
not add to the accuracy of prediction 
of second year's grades from first 
year's grades. When differences be- 
tween grades from quarter to quarter 
were introduced as additional predic- 
tors in the multiple regression analy- 
sis, the correlation was raised from 
.63 to ,64, nothing to support the ad- 
visers' belief that "improvement" was 
an encouraging sign for a boy who made 
a poor start. 

Using part correlations, Willingham 
showed that if one is given a freshman 
grade average at Tech for a student, 
then knowing his SAT scores, or high 
school grades, or the average predicted 
for him at Tech before entry, does not 
help predict subsequent grades during 
his career at the institution. This 
finding is, of course, disheartening 
to the adviser who would like to believe 
that the boy of promise who is now fail- 
ing may suddenly "bloom." The data in- 
dicate that if he does not sprout prompt- 
ly in Tech's atmosphere, he is not likely 
to sprout at all. The bag of correla- 
tional tricks ~=^n help resolve some most 
interesting qut. ions about scholastic 
progress . 

Analysis of Covariance 

The analysis of covariance that was 
discussed earlier can also be very hand\ 
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when considering questions having to 
do with SCuO Iisti.c progress patterns. 
One matter that deserves concern is 
the fact that women usually obtain 
better school and college grades than 
men of equal ability. Whether* it is 
right or wrong that this is the case^ 
we need to be aware of it and the ex- 
tent to which it is true, In^ Georgia, 
some claim that the cause of the phe- 
nomenon is known; girls are graded on 
the "curves," I think that there may 
be other factors involved also, A 
friend of mine who is a very good 
accountant was downgraded on a paper 
for a class in religion in which he 
spelled "prophet" incorrectly each 
time. For him the word is "profit"! 
Seriously, some faculty still contam- 
inate their evaluations of course 
achievement by such important but ir- 
relevant considerations as class at- 
tendance, charm, cleanliness, conform- 
ity, decorum, docility, promptness, 
and punctuality. It is a matter of 
institutional philosophy whether such 
practices will be condoned, but if they 
are permitted they will be reflected in 
a handicap for the male student. 

Covariance analysis will also help 
detect whether grading standards in an 
institution are floating. By that I 
refer to the customary finding that as 
the quality of the students improves 
through selective admission, the mean 
grade remains constant, I also refer 
to the experience of the registrar at 
the University of Georgia who once put 
all the top applicants into one section 
of freshman Englishr You can guess 
what he found; there were as many F's 
in that section as in any other. When 
I find floating grades, I suspect that 
an i'^stitution has not carefully formu- 
lated its goals and has not worked to- 
ward a careful definition of what it 
wants its students to achieve and a 



means of ascertaining when that achieve- 
ment has taken place. As important as 
evaluation and knowledge of results 
• are to learning, measurement of achieve- 
ment is one of the weakest links in to- 
day’s education. 

Analysis of covariance also made 
it possible for us to demonstrate that 
requiring football players ^ be in a 
certain room for a certai^ time period 
each day and not permitting them to 
talk during this "study" period im- 
proved their grades significantly over 
what would have been expected on the 
basis of their ability. Findings such 
as that may help the institutional re- 
searcher to convince the important 
people on a campus that his efforts 
are worthwhile! 

I have spent most of this time 
talking about methods, I was asked to 
concentrate on methods rather than 
findings. You will note,' though, that 
there is an interplay between methods 
and questions, and between questions 
and facilities, and between all of 
these and the training of the research- 
er, Given a competently- trained re- 
searcher, the questions he asks will 
probably depend pn whether he has avail- 
able data-processing facilities of suf- 
ficient scope that it will not take him 
forever to analyze the data. Even with 
computers, a method for which a com- 
puter program is already available is 
more likely to be used. Of course, 
sometimes a question will be so inter- 
esting that a method will be found or 
invented, bul it seems to me more often 
that a method will suggest a suitable 
question, and the discovery pf a new 
method will bring questions to the sur- 
, face that had previously been submerged. 
So the researcher who* has the most 
methods at his command may appear to be 
the one who asks the, most and the most 
interesting questions. 






EXHIBIT A 

(Adapted from Supplement to Counselor's Guide to Georgia Colleges) 
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EXHIBIT C 

Worksheet for Ccroput.ition of Cutting Score 



LINE FOR MALES HOW OBTAINED 



1 


750 


Enter the numl>er of Anticipated Applications for the 
Fall Quarter of the coming year. 


2 


500 


Enter the number of desired Entering Freshmen for the 
Fall Quarter of the coming year. 
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266 


Enter the number of Accepted Applications for the Fall 
Quarter of the previous year. 
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221 


Enter the number of Entering Freshmen for *.l«e Fall 
Quarter of the previous year. 
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Compute the ratio of Accepted Appli. to Ent. Frosh. by 
dividing Line 3 by Line 4. 
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Compute the number of Applications to Accept by 
multiplying Line 2 by Line 5. 
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Compute the per cent of Applications to Accept by 
dividing Line 6 by Line 1. 
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Find the percentile interval in which the cutting 
score will fall by subtracting Line 7 from 100%. 
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2.0 PFAG 


Read down the column labeled All Applicants from the 
table for males until finding the 7oile that is closes-t 
to the %ile on Line 8. The PFAG that corresponds to 
this 7oile is the PFAG Cutting, Score. 
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EXHIBIT D 

Ryan Test for Multiple Comparison of Means 
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PLANNING COLLEGE FACILITIES 

e 



John X. Jamrich 
Associate Dean, Coiiege of Education 
Michigan State University 



THE IMPORTANCE of systematic study 
and planning cf educational facilities 
must be underscored on educational 
grounds even though the do liar- values 
may, perhaps, be more easily discern- 
ible. The degree to which a given col- 
lege can continue to provide relevant 
and significant experiences, at a 
quality level, will certainly depend 
upon its ability to create an instruc- 
tional program in response to the de- 
mands of its clientele. This, in 
turn, will depend upon the appropri- 
ateness of the instructional facili- 
ties- to the kind of program which is 
envisioned at each institution. The 
systematic approach to planning, then, 
assures a continued dynamic quality to 
the curriculum and the physical facil- 
ities in which the program is housed. 

In a majority of colleges there 
probably exist campus plans, though the 
character of these plans varies widely. 
Within recent years, an increasing num- 
ber of colleges have developed detailed 
’’master plans” which are being followed 
and which were based on very careful 
analyses of the total institution. In 
most cases, however, it would appear 
that the plans that do exist are rela- 
tively limited in scope and consist 
primarily of informal sketches of the 
campus or of some portion of it with 
little or no basis in a thorough in- 
stitutional study. 

Increasing concern for the inte- 



gral relationships between the instruc- 
tional program and the facilities is 
being reflected in campus plans which 
are evolving in a number of institu- 
tions. Of course, in most institutions 
wtiich have been in existence for dec- 
ades, it would be difficult if not en- 
tirely impossible to recreate the en- 
tire campus arrangement in accordance 
with some of the principles of facil- 
ities interrelationships. The roost 
vivid demonstration of these evolving 
plans finds its expression >in these 
situations where a college, ^after 
thorough study, decides that its pre- 
sent facilities, are or w^lll shortly 
become inadequate for the level of en- 
.rollments and the type of instruction 
which it intends to provide. These 
colleges have been able to develop 
their plans with relatively minor limi- 
tations, except perhaps, the existing 
traditions in the minds of the colleges, 
and campus planners. 

One of the first steps in develop- 
ing a sound campus plan and ascertain- 
ing needs is to make a complete inven-- 
tory of the present physical plant. 
Here, attention should be given to such 
factors as the age of the buildings, 
their adequacy from an engineering and 
instructional point of view, whether 
the use is for residential or non- 
residential purposes, and whether it 
is used for instructional or non- 
instructional activities. Also in- 
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eluded should be some information re- 
garding the dollar investment in the 
buildings ; the source of the funds ^ 
and, of course, the total square feet 
of space in each of the categories. 

The judgment of adequacy should 
be made in terms of (1) the structur- 
al characteristics of the space and 
(2) the appropriateness and adequacy 
of the facilities for the type of in- 
struction contemplated now or possible 
in the future « In one study of col- 
lege facilities, it was found that 
froQi> one- fourth to one- third of pre- 
sent facilities would be judged in- 
adequate for one or both of these 
reasons . 

Improving Space Use 

Emphasis must be placed on the 
,fact that increased use of instruc- 
tional facilities is not an end in it- 
self, but should reflect careful con- 
siderations of the instructional pro- 
gram in relation to such increased 
use. Several factors can be noted as 
important in the attempt to improve 
utilization: 

1. Class schedules must make use 
of the e^ire 8-hour day and 
the 5 -day Feek. 

2. The units of curriculum need 
to be studied to see possible 
modifications and their ef- 
fect on utilization. 

3. The weekly schedule, as well 
as the length of the day, may 
have to be lengthened. 

4. Clearly, additional students 
can be accommodated by means 
of a lengthened school year. 
Exploration should be made of 
the traditional question of 
student station occupancy for 
each credit rendered in a 
course. 

Exploration should be made of 
the que&; ion of the need to 
provide such extensive labora- 
tory space and equipment for 
the non-science major as is 



provided for the majors* 

7. Planning new facilities should 
include considerably more 
flexibility for use than some 
of the traditional construc- 
tion. 

8. Careful attention should be 
paid to the size and shape of 
each room. 

# 

Suaanary of the Planning Process 

The approach of institutions to 
the problem of assessing and providing 
for physical facilities needs, as well 
as other institutional problems, is 
more than li-kely to be approached in 
a fairly informal and unsystematic 
manner. There is very wide variation 
in the extent to which faculty partic- 
ipate in the initial planning and 
study. Furthermore, there is wide var- 
iation in the scope of studies which 
the colleges undertake in their attempt 
to assess their individual problems. 

More often than not, the decisions 
regarding the needs for facilities ap- 
pear to have been based on some pro- 
jections of enrollments for the collegt. 
without full study of the nature of 
these enrollments, the implications 
for the curriculum and for instruction, 
and the resultant staff needs. These 
in turn affect the financial base from 
which a college can move toward pro- 
viding new buildings. 

When the planning by colleges is 
vievjed in broad perspective, it becomes 
clear that there are several factors 
which are inseparably intertwined and 
which must be studied thoroughly in the 
process of establishing facilities needs 
in a college. 

Enrollment 

1. What have been the trends in 
institutional retention rates? 

2. Where have the students come 
from? 

3. Are there new geographical 
areas of service which can be 
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dv»ve loped for additional stU“ 
dents? 

4o What has been the academic 
potential of the students? 

5. What have been the most fre- 
quent areas of stud> of past 
students? 

6. How will future enrollment of 
this institution reflect the 
state and national trends ex- 
pected? 

?• What would be a realistic level 
of enrollment to expect during 
the next two decades? 

8, Given these levels and improved 
retention rates ^ what can be 
the expected enrollments in the 
several classes of the colleges? 

Faculty 

1. What is the level of prepara- 
tion pf the present staff? 

Should this be improved? If 
so, where will the source of 
such improved staff be? 

2. How many new staff will be 
needed in the specific areas 

of study to provide for retire- 
ment alone? 

3. How many will be needed to pro- 
vide for the increased enroll- 
ments, assuming no change in 
the present program and in- 
structional program? 

4. How many will be needed if cer- 
tain changes are effected in 
the curriculum and instruction 
after careful study of these? 

5. How has the current salary 
schedule provided for competi- 
tion for the types of faculty 
needed? 

6. What will the level of salaries 
have to be during the next 20 
years to provide for retention 
and attraction of competent 
staff? 

Curriculum and Instruction 

1. What are the purposes and ob- 
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jectives of the college and 
.how are they translated into 
operational terms in the class- 
room and; the campus as a whole? 

2. How appropriate is the present 
curriculum for, the above ob- 
ject/, vos and purposes? . " 

3. Hew Appropriate ifi the curric- 
ulum for present and future 
social)' technical^, .'and cultural 
demands? 

4* What is the scope ot uie present 
curriculum in terms of the num- 
ber of courses, the number of 
majors , and the number of dif- 
ferent prOgramfe offered? 

5. Whet are the present practices 
^ in class size? ' 

6. What are the present practices 
in faculty teaching load and 
other resp.onsibilities? 

7. How adequ'ate\are,^thc supple-, 
inentary learning , facilities 
such as the library?" 

8. How do class sizes vary from 
subject area to subject area? 

How is .this related to the 
matter of instructional budget 
allocation and to the stated 
purposes of the institution? 

9. What is the extent of smell . 
classes being taught— classes 
enrolling less than five and 
less than ten students? 

10. How extensively are large 
classes utilized in the in- 
structional program of the 
college? 

11, How can educational quality be 
. retained, and at the same time 

provide for the needs of stu- 
dents through a compact and 
efficient program? 

Finances 

1. What is the level of the total 
income of the institution and 
what proportions of it are de- 
. rived from specific sources 
such as student fees, endow- 
ment, gifts, church or other 
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appropriations? Are these 
proportions in line with those 
in comparable institutions, 
an4, even though the propor- 
tions may. be high enough, are 
the actual amounts available 
sufficient to provide oper- 
ating capital for^ the important 
phases of instruction and other 
elements of the college? 

2. I^hat is the economic level of 
the student clientele? 

3. If it is a church college, what 
is the economic potential of 
the church constituency? 

4. Has the alumni group^ been 
brought to a satisfactory 
level of contribution? 

5. What are the factors which 
inhibit the better use of 
space on this campus? 

6. If new space is needed, what 
should be its extent and 
specific character to provide 
for the type of instructional 
program which the college 
plans to offer? 

7. How will new facilities be 
financed? 

Tiie implementation of studies de- 
signed to provide institutional data 
on these items is vital to an adequate 
assessment of need for new facilities 
and programs for the college. One ef- 
fective vehicle for planning and car- 
rying out such studies and then coor- 
dinating and relating the results to- 
ward a unified plan is to be found in 
a Faculty-Administration-Board of 
Trustees Committee. It is clear that 
this single committee would not take 
on the responsibility of planning and 
actually carrying on all of the 
studies, but such a single group is 
essential to provide the necessary 
leadership and coordination to make 
for success of the procedure. 

A general sketch of the entire 
planning process is shown in Figure 1. 
Here the role of the primary committee 
and small staff committees appointed 



to conduct the studies 'ia* shown. Also 
indicated are the possible roles which 
educational consultants, and architec- 
tural planners can play and where their 
most effective contribution can be made. 
Most impertant of all, the diagram at- 
tempts to portray the inseparable re- 
lationships ^among the various institu- 
tional factors in the determination of 
institutional needs of any sort. 

Perhaps the mo^t evident observa- 
tion that can be made relates fo the 
manner in which the colleges, large and 
small, which have not developed a total 
institutional plan can be assisted in 
this effort. There appears to be a 
need fop the identification and estab- 
ll.chment of regional resource arid ref- 
erence centers to which all colleges . 
could look for compe'^ent and experienced 
assistance in the development of total 
institutional study plans as .well as 
professional assistance in carrying out 
these plans. 

The second observation relates some- 
what to the first, but from a somewhat 
different point of emphasis. As the' 
colleges study themselves and plan, it 
is evident that the one thing which 
emerges is the concern for the relative 
significance and interrelationship of 
one factor of the college picture to 
another. For example, if the faculty 
attempt experimentation with different 
class sizes and at the same time make 
certain modifications in the number of 
hours taught. and major areas of study 
offered, what implications does this 
have for faculty and student load and 
for the salary levels of faculty mem- 
bers? What can the college expect of 
enrollment Increases In total and in 
pertain subject areas?. How does the 
level of possible space utilization 
relate to scope of course offerings and 
class size? 

There is need, then, for a system- 
atic research into the total program- 
ming of the managerial aspects of the 
college. Is it possible, for example, 
to construct an abstract model of a 
collage which then can be utilized to 
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yield useful information to our col- 
leges and universities in the transi- 
tional stage from one enrollment lev^l 
to another and from one type of in- 
structional procedure to another? Re- 
search into this phase of the college 
problem would, perhaps, yield results 
useful to them in their plans for 
additional ph^^sical facilities as well 
as in other aspects of their programs. 

There is one additional area in 
which considerably more research is 
needed. There is a need to bring to- 
gether research on the adequacy of in- 
structional facilities in terms of 
their relationship to effectiveness 
of instruction. That is, what dif- 
ferences in the quality of learning 
can be observed under different con- 
ditions of physical plant environment? 

Planning for Future Facilities Needs 

As colleges and universities at- 
tempt to assess the extent of their 
future physical facilities needs, and 
as they attempt to evolve plans for 
meeting these needs, it is becoming 
increasingly evident that the process 
of assessing the need and planning to 
provide for it cannot be carried out 
in isolation from the total complex of 
the institution. Thus, the need for 
new instructional facilities should be 
a direct response to the need for an 
Increased volume of instruction. The 
planning for these instructional facil- 
ities must take into account the spe- 
cific curricular factors which are ** 
giving rise to the need. The exact 
character of such a classroom facility 
can only be established by considering 
Lhe detail? of the anticipated enroll- 
ment growth. And certainly, the pro- 
vision of new facilities or the replace- 
ment of obsolete units cannot be car- 
Tied out without full awareness of the 
total financial status of the institu- 
tion, the scope and diversity of the 
curriculum, and the provision for and 
utilization of faculty and staff. 

Let me turn to two other topics 



v?hich I should like to. discuss briefly, 
namely, the idea of a Learning Resources 
Center and the Living-Learning complex. 

Learning Resources Center 

The major purpose of a college or 
university is to. provide an optimum en- 
vironment for the teaching- learning 
process, whether this process takes 
place in a foriual classroom setting or 
is provided for through other means. 

The problem of creating such an environ- 
ment is compounded by many factors one 
of the most difficult being the attempt 
to fulfill the functions of storage, 
retrieval, and distribution of, the rapid 
ly accumulating volume of knowledge, in- 
formation, and facts. Whether we are 
talking about the general field of sci- 
ence, or humanities, economics, mathe- 
matics, or literature, the magnitude of 
this challenge is obvious. The solu- 
tions, however, are not quite as obvi- . 
ous, and if they may appear to be logi- 
cally, there are a variety of factors 
which still stand in the way. 

Furthermore, the problem is com- 
pounded by the imminent and already 
present levels of student enrollments 
and the current limits of avallat le 
qualified staff in many areas. These 
and other aspects o£ the problem would 
appear to indicate that the effort to 
optimize the teaching- learning environ- 
ment can be facilitated if: 

1. our institutions and faculty 
groups would devote sufficient 
time and effort to identifying 
learning objectives; 

2. careful thought would be given 
to how these objectives might 
be attained most effectively 
and efficiently; 

3. institutional and faculty effort 
were to be provided such that 
the conditions of learning and 
resources for learning and 
teaching can be so marshalled 

as to assure maximum learning 
by students; and 

4. institutions and faculty would 
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give careful thought to iden- 
tifying the optimum conditions 
for learning. The lack of 
direct attack on the human 
factors in learning is most 
distressing; though we appear 
to know a great deal about how 
’’birds learn to distinguish 
poison seeds from non-poisonous 
ones” and how pigeons learn to 
walk in figiive eights. 

It is perfectly obvious that college 
students learn through a variety of for- 
mal and informal procedures, including 
class meetings as well as reading of 
books ; informal discussions , and the use 
of audio and visual equipment. The.se 
efforts on the part of- the student may 
be stimulated or hampered by the total 
environment of the college campus. Even 
our relatively meager knowledge of the 
learning process provides certain prin- 
ciples and guides which, if applied, 
would assure more effective learning 
by students. For example, students 
should be led to recognize the need to 
learn and should be assisted in seeing 
the various relationship.*? which exist 
among the hundreds of facts which are 
being learned. They should have an op- 
portunity to reiniorce their learning 
and must be given some assurance that 
ihev are progressing toward an objec- 
t Ive. 

In general; teaching- learning in 
colleges has not been developed as a 
unified system of instruction . If 
there is any unity in the existing 
knowledge; the learning experiences 
should be so designed as to reflect 
this unit>\ This can be done most ef- 
fectively ifs^ well-planned system of 
instruction is developed by the faculty 
of a college. 

How is such a system to be achieved 
and what role can modern technology play? 

To move in the direction of system- 
atic instruction on our campuses will 
generally require a ’’new look” and a 
new point of view by members of the 
faculty. It will require a ’’new look” 

•IS far as most campuses are concerned 



in^ terms of services and resources. In 
all probability, the implication of all 
this is that a new coordinating agency 
may evolve on our campuses. Such a unit 
might be called upon to: 

1. seek and provide information 
regarding the optimum condi- 
tions of learning; 

2. provide for the coordination 
of all facilities dealing with 
the storage; retrieval, and 
distribution of knowledge; 

3. provide professional help in 
the development of learning- 
teaching materials for both 
the faculty member and the 
student for purposes of indi- 
vidual learning effort; and 

4. be involved in the planning 
and evaluation of the total 
instructional effort of the 
college. 

Suppose that; without going into 
greater detail, one were to adopt such 
an idea. What would be the nature of 
the Learning Resources Center on a cam- 
pus? What would it include and how 
would it be housed? 

A coordinated learning resources 
center would contain: 

1. appropriate equipment and facil- 
ities for individual student 
learning activity designed to 
present basic factual materials 
for courses as well as to pro- 
vide the opportunity to review 
presentations already encounter- 
ed in class; 

2. appjL'priate equipment which 
would enable the faculty members 
to carry on efficient indivi- 
dualized study and research; 

3. the traditional library, and 
more, with a new orientation 
to storage a'ld retrieval of 
knowledge; 

4. materials for presentation pre- 
parations by faculty and students; 

5. audio and visual equipment needed 
for the use of the materials pre- 
pared for presentation; and 

6. professional staff competent to 
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carry on research in learning^ 
materials development^ evalua* 
tlon^ and equipment maintenance. 

There has been considerable discus* 
slon as to how such a facility should 
be housed. In the Ideal^ perhaps^ the 
unit should be on a centralized basis 
with adequate provisions fot campus* 
wide dissemination to selected class* 
rooms and residence halls. At the same 
tlme^ our campuses already have several 
pieces of such a unit In existence. 

Some have closed circuit television^ 
others have Instructional materials 
centers^ and^ of course^ all have tra* 
dltlonal libraries. The cost of com* 
pletely centralizing these would be 
extremely hlgh^ so the question Is 
how to bring about a systematized In* 
structlonal program without excessive 
cost and duplication. 

In all probability^ the present 
library facilities and existing closed 
circuit facilities can be tied in with 
any unit which would be centrally 
housed. The real hurdle Is not this 
physical centralization but^ In all 
probability^ the need to centralize 
the focus of instruction by members of 
the faculty and to bring about the rec* 
ognltlon that the utilization of such 
a facility can enhance the teaching* 
learning process immeasurably. 

Living*Learning Complex 

Now for the second item. Closely 
related to the matter of the teaching* 
learning environment is the manner in 
which we have utilized or not utilized 
our residence facilities to carry on 



or even reinforce the effects of the 
Instructional program. Even a casual 
observer of the campus scene will 
readily see that colleges have failed 
to capitalize on the out‘of*class en* 
vlronment for e.ctendlng the ins true* 
tlonal program. They also have not 
capitalized on the possibilities for 
the living environment of the student 
to inject an "intellectual level" Into 
the life of the student. 

The primary reason for this probably 
lies in the fact that as our campuses 
grow larger and our residential facili* 
ties expand^ it becomes increasingly 
difficult to weave the residential 
facilities into the Instructional fab* . 
rlc of the campus. 

The attempt to construct Ins true* 
tlonal facilities in our residence halls 
promises to provide for at least two im* 
portant elements of college campus life: 
(1) it should give us a greater oppor* 
tunity to utilize the non*class time of 
students to reinforce learning; and (2) 
it will give us an opportunity to pro* 
vide for "a college within a college" 
sort of identification for the student. 

A number of such facilities have 
evidently been constructed. One such 
plan looks something like Figure 2. 

In conclusion^ It Is Important to 
emphasize that space utilization data 
as such provide only one point of ref* 
erence in the planning of Instructional 
facilities. Even more important^ per* 
haps^ is the need to approach system- 
atically the total planning process and 
to relate the planned facilities to the 
Instructional program to be housed in 
them. 
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IF THERE WAS a time when research 
upon their own operations and struc- 
tures was not a recognized necessity 
in some academic institutions^ that 
time is long past. Not past at all 
is the period when the diffusion of 
this understanding was sporadic^ too 
often patronized^ and too little seri- 
ously undertaken even by those compre- 
hending -it. 

Even today I suspect that a major- 
ity of institutions of higher education 
do no such research and would be unable 
serious* to undertake any if they so 
des'lr^ed. Certainly only a very few 
maintain offices or staffs for that 
purpose^ or have any continuing pro- 
grhic in it. This is a strange stafe 
of affairs because^ in some academic 
circled jst leasts the necessity for 
continuous apprehension of the state . 
of the institutibn'^is well known and’ 
well practiced. Ifiy even beginning 
to be recognized that for many of our 
larger or more strategic uhiversities 
and colleges such auditing, has become 
a national necessity. 

The reason why this should be true 
is not hard to discover^ of course. 

This is a period of radical expansion 
for our colleges and universities in 
student enrollment^ in faculty, and— 
most significantly — in purposes and 
functions. More and more they are 



being recognized as key ingredients 
for at least two processes vital to 
the national well-being; the dissem- 
ination of higher education to ever- 
increasing proportions of the popula- 
tion, and the conduct *^of both basic 
and applied research enterprises. 

Significantly, however, these ex- 
pans ipns are taking ptlace at a time of 
increasing expansion of other areas of 
national lite..which compete with the 
educatiOnAl institutions for time, per- 
sonnel, and funds, whether from taxes 
or private endowments. Thus, to use a 
slang term, "the squeeze is on" the 
schools to perform more efficiently 
than ever before dp. expanded and im- 
mensely expensive program under hither- 
to unknown pjtpssures. 

In* these, circumstances, the abso- 
lute, necessity .^f or searching self- 
scrutiny, od the part of the educational 
institutioiis sh0ul4 bd readily apparent: 
we can no. longer afford the fiscal, op- 
erational, and functional laxity with 
which we might ;havis , operated as little 
as fifteen years, agp; I suspect that 
all educational a^lnlstra tors are only 
too familiar with the dollar squeeze 
and the space squeeze as these terms 
^pply to depar^tmental budgets and hous- 
ing. Typically, in the larger univer- 
sities, these pressures are met by 
rigorous analysis of requests, appro- 
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priations, and opera* io.,& m crder to 
wring every possible use out of every 
dollar and every foot of floor space. 
Equally typical, however, has been the 
failure of most educational institu- 
tions, even those used to the concept, 
to subject other areas of their opera- 
tion and structure to similar scrutiny» 

It is my purpose today to sugges*. 
to you some aspects of the educational 
enterprise which bear serious faculty 
and administrative study tor the pur- 
pose oi more efficiently and satis- 
laotoriiy performing the operations 
with wl* *.ch they are charged. Some of 
the ideas I will propose ere highly 
sociological in nature; others are 
more purely administrative. All bear 
upon the demand for more a':curate and 
more reliable information (facts) 
about the actual nature of the inst.'-. 
tutlonal operation--somethlng about 
which :e really know surprisingly 
liltl . Let me attack them seriatim ; 

Faculty Characteristics 

We know a fair amount about the 
characteristics of American college 
or university faculty members : their 

social origins, training and experi- 
ence, religious attitudes and politi- 
■?al behaviors, etc. We know practi- 
cally nothing about the characteristics 
of faculties as social groups or organ- 
izations, work units, which is indeed 
surprising since it is this aspect of 
them with which we must continually 
deal. In this regard, I should like 
to commend to you the \itility of simple 
descriptive statistics, which may be 
competently gathered by any steno- 
grapher from available records. With 
these as a base, a number of interest- 
ing and important auditing functions 
can easily be performed annually or 
even, if desired, upon a semester 
basis. 

Probably the most useful of these 
auditing functions is what I like to 
call "vacancy control," which is sim- 
ply a term for the review of all budg- 



et items for personnel positiens 
falling vacant in any given year. A 
variant of it might even be employed 
for equipment and maintenance funds as 
well. The operation of the procedure 
is simple: every time a person leaves 

the emplojmient of the university, the 
funds which supported him in his depart- 
ment, division, or office dissolve, and 
are turned over to general funds for 
disposal as needed. In order to qual- 
ify for a continuation of the position, 
the department or office which held the 
vacated position must justify its con- 
tinuing need for it in exactly the same 
way it or any other department would 
have to justify the creation of a new 
position. If other needs appear more 
pressing, the request is denied in 
favor of the more exigent one even if 
the latter falls in some other area of 
operation entirely. 

This is, of course, not a statis- 
tical procedure, but the decision to 
continue or deny the position can be 
greatly facilitated by the collection 
of basic statistical Information about 
the operation of the competing depart- 
ments. In this regard, I should like 
to describe for you a device with which 
I became acquainted while assistant to 
the academic vice president at the 
University of Minnesota. This was a 
docianent called the "course inventory," 
routinely compiled by IBM machine every 
quarter and summer session. It listed, 
mechanically, every course offered in 
the university that term by department 
and college, together with the room 
size of the space in which it was of- 
fered, enrollment by size, college, 
class, and sex, and the name of the 
instructor with his salary and term of 
employment. 

A second section of the same volume 
was devoted to academic personnel on 
the payroll in the given term, showing 
for each person his class assignments 
with enrollments broken down as des- 
cribed, clock and credit hours for each 
course, and salary and term of employ- 
ment. In this document, then, the 
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university had a complete record not 
only of exactly ^^hat every student was 
taking and its faculty actually teach- 
ing, but of its teaching use of physi- 
cal plant as well. (If you consider 
this a moment, I will probably not 
tieed add that a check of the actual 
utilization of teaching space demon- 
strated that, although all buildings 
were apparently being used to near- | 

capacity, the actual employment of 
teaching rooms and laboratories, 
based on a 44 hour week, was only 
about 25%. This survey, in itself, 
is a highly useful one.) 

With this information about de- 
partmental and individual operation 
in the teaching endeavor, plus more 
personal information from the faculty 
personnel records file, it should be 
possible for a university to maintain 
a continuing audit of departmental 
trends in hiring, teaching, enrollment, 
research, productivity, and even to 
some extent employ a measure of quality 
control in hiring and firing as well as 
operation. 

A similar elementary audit — which 
so far as I know is nowhere used in 
higher education— is the exit inter- 
view with departing staff members to 
det'^rminc the causes of their depar- 
ture as well as their destinations. 

Both of these items of information 
should be of concern to an institu- 
tion because, collectively, they tell 
it a great deal about its nature and 
policies as they appear to its em- 
ployees as well as give it a measure 
of turnover in amount and quality. 

These are simply auditing func- 
tions which may be carried on statis- 
tically from the central administra- 
tion with regard to either faculty or 
staff problems. Rather more compli- 
cated, though perhaps not in the long 
run any less pressing, are some topics 
for more purely sociological research 
which I urge that someone should be 
looking into. These could Include 
the £:llowlng as starters: 



1 . The Characteristics of Depart- 
mental Productivity 

We know a fair amount about indivi- 
dual productivity; what urges drive the 
scientist to his work ot the humanist 
CO his typewriter. We know practically 
nothing about the social situations In 
which we employ such persons as those 
situations may induce or impede those 
urges. This is passing strange, too, 
since in most instances it is the col- 
lective product with which the admini- 
strator is concerned. (Generally speak- 
ing a productive department i£» of great- 
er value to the university than a pro- 
ductive Individual in a department 
otherwise undistinguished.) On a com- 
mon sense and experiential basis, how- 
ever, there seems little doubt that 
the departmental "atmosphere," that 
elusive thing called "working condi- 
tions," is of significant importance 
to individuals in their work. Indeed, 
even entire campuses sometimes partake 
of a single collective working gestalt . 

We all know of departments remark- 
ably productive, composed of indivi- 
duals busy at their tasks and perform- 
ing well at them, while elsewhere on 
the same campus are other departments 
composed of men oi equal merit, doing 
little of any apparent significance. 
There is some tendency to explain these 
differences as being due to the nature 
c£ departmental administration or ad- 
ministrators, or sometimes departmental 
histories; these nypotheses may be cor- 
rect, but they should be investigated 
and their empirical concomitants idt::n- 
t if led and explained. 

2. The Academic Department as a 
Work Group 

Similar investigation should be 
undertaken of a closely applied topic: 
the academic department as a work 
group. We all know of the Bank Wiring 
Room at the Hawthorne electric plant 
forty years ago, and of the effects oZ 
various externally induced changes upon 
the work groups therein. Not only is 
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nothing known of the academic depart- 
ment as a work group but it is usually 
not even conceived as such although^ 
is indicated in the preceding discus- 
•iion, the consequences of its exist- 
ence are quite real indeed. This may 
be especially important for those de- 
partments doing teaching chores re- 
quired by university curriculnni or by 
law. such as the offering of United 
Stat-‘‘s History for all freshmen, or 
the teaching of basic English. 

3. The Effectiveness of Depart - 
mental Administration 

Again closely paralleling ideas 
already set forth would be ^ investi- 
gation of the effectiveness of depart- 
mental administration and the concom- 
itants of effective and ineffective 
administrators and administrative 
techniques. The answer to the query 
"Effective for what?" will of course 
be determined by the administrative 
end- in- view and will in turn deter- 
mine units to be studied as well as 
particular investigative techniques. 

The Nature and Effects of 
Faculty Peer Groups 

Still paralleling some of these 
ideas is yet a further one: studies 

of the nature and effects of faculty 
peer groups on such matters as the 
effectiveness of departmental admin- 
istration, the limitation or maximi- 
aation of faculty productivity (for 
who can deny the existence of depart- 
ments with faculty norms for work or 
non-work), the types of productivity 
characterizing a department or a 
faculty, and even the operation or 
consequences of administrative policy. 
(And here all of us must recognize a 
tendency to believe that any process 
over which we exercise initiation or 
control is necessarily delimited 
largely by our efforts, as teachers 
in the classroom over students, or 
as administrators over faculties. 

Yet nothing could in fact be further 
from the truth. My ability to assign 



»Fork in furtherance of some end for my 
students is flatly circumscribed by 
their willingness tc do it, and is sub- 
ject tc student norms of what consti- 
tutes "fair" or "reasonable" expecta- 
tions and performance.. The president's 
ability to impose changes in policy 
■upon the faculty is similarly circum- 
scribed by their willingness to adopt 
or act upon them.) 

I recognize the poverty of these 
few suggestions for useful research 
which might be under taken- -indeed I 
might say must be undertaken--upon fac- 
ulty characteristics. I offer them 
only to indicate the direction and the 
need. We know so little, actually, 
about such matters that the pressing 
question is not what to do but where 
to start doing anything. The field is 
open. 

Non-Academic Personnel 

I have indicated that the study of 
socially significant aspects of faculty 
characteristics is rare. Almost totally 
unknown is the study of the character- 
istics of non-academic personnel and 
departments. Some of the information 
I have suggested as needed for facul- 
ties and their departments is obviously 
applicable to staff and their depart- 
ments or work units as well. I should 
like to suggest briefly some other 
studies of staff, or non-academic per- 
sonnel, which would also be worth 
undertaking as institutional research. 
Again, each of these is just a sugges- 
tion offered as a heuristic device, or 
as proposed information-collection to- 
ward the solution of a single problem, 
but they may sen/e to suggest others. 

1. The Influences of Non-Academic 
Personnel . Policy Making , or Depart - 
mental Procedures on Academic Matters 

I belie^ e it may not be generally 
realized that, in seme areas of the 
university's academic life, a great 
influerxe is exerted on the manner in 
which academic affairs are carried on 
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by completely non-academic consid8ra~ 
tions. You are all familiar vith, and 
I have alluded to, the problems of 
space. Deans and department chairmen 
are familiar with some ways in which 
space limitation, or the nature of 
available space, may influence such 
academic matters as research programs. 
Most research professors are aware of 
some ways in which, to give another 
example, fiscal rules and procedures 
saay color, limit, or, in the extreme 
case, determine, a research program. 
Examples are endless. But there may 
be other examples of unknown and un- 
intended consequences of the univer- 
sity's "business" operation for aca- 
demic affairs which could and should 
be explored. For example, do admis- 
sion regulations, intended to discour- 
age less promising students from be- 
gi.nning their programs at junior col- 
leges and then transferring into the 
university in later years, actually 
have the effect of encouraging them 
to start at the university, thereby 
swelling its freshman enrollment and 
failure rate instead? If, as is com- 
mon, the Office of the Registrar as- 
signs classroom space, what effect upon 
a department's program does the avail- 
ability or non-availability of large 
classrooms produce? Do registrar's 
regulations , intended to maximize 
building use by requiring classes to 
be offered at hours and days unpopular 
with students, have differential ef- 
fects upon required and non-required 
courses and departments offering them, 
as well as upon teachers? How do stive te 
laws requiring or forbidding certain 
types of expenditure affect research 
programs, faculty recruitment, etc.? 

2. Survey of the Faculty's Per - 
ceptions of the Powers and Practices 
of the Non-Academic Staff 

Related to these considerations 
would be a survey of the faculty's per- 
ceptions of the powers and practices 
of the non-academic staff and depart- 
ments and resultant faculty behavior 



toward them. This would strike at the 
heart of a major communication problem 
dogging many universities. All too fre- 
quently a great deal of resentment and 
inefficiency results from misinformation 
about simple matters of how-to»do-it, 
or why things are done in a given way, 
or the lack of such information. The 
study suggested, by discovering what 
the faculty believed, would indicate 
such points of ignorance or misinforma- 
tion which could then be clarified. A 
reverse study of the staff's perceptions 
of the faculty, and its role in relation 
to them and the university, might also 
be of great value. 

"^^he Day - to-Day Operation of 
Non-Academic Departments 

Another area of often unrelieved 
ignorance about the actual operation 
of our institutions is that of the day- 
to-day operation of non-academic depart- 
ments. In this regard I can recommend 
a procedure I have followed myself a 
time or two, always to my considerable 
illumination. This is the technique 
of shadowing a given piece of paper, 
or operation, through all steps routine 
for it from inception to fulfillment. 

For example, what exactly happens to a 
standard purchase order for, let us 
say, a ream of paper from the time it 
leaves the typewriter of the depart- 
mental secretary until the time the 
paper is delivered to the department? 
Even a simple calendar of locations 
and times for the trip may be reveal- 
ing for administrative purposes, and 
if these are combined with brief inter- 
views of every person handling the form, 
the results may well be eye-opening. 

To illustrate, the University of 
Minnesota once operated a campus mail 
service which it used to communicate 
with students as well as with faculty 
members and departments. Communicaticnv' 
from the Registrar or Deans' offices 
would be put into the campus mail and 
eventually be placed in mail boxes lo- 
cated in the U.S. postal station in 
the student union. Each student was 
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required to maintain a post box, the 
rental charge for which was added to 
his tuition fees, and to visit the box 
at least twice weekly. In connection 
with a physical survey of the union in 
which it was necessary for me to create 
space for an expanding service by steal- 
ing it from existent others, I natural- 
ly eyed the vast area filled with stu- 
dent mail boxes with great envy. When 
it became apparent that the mail box 
area was the only one which could pos- 
sibly be used for the necessary expan- 
sion, it occurred to me to inquire into 
its actual use. A shadowing of a piece 
of routine mail in the way just des- 
cribed, plus some elementary arithme- 
tic, disclosed that it was costing 
the university some 8-1/2 cents to 
send a notice to a student by campus 
mail which could just as well have 
been sent to his residence by U.S. 
mail for, at that time, 3 cents. 

This or similar techniques are in- 
valuable for disclosing operational 
"bottlenecks," communications lags and 
breakdowns, administrative, procedural, 
or policy obsolescence, etc. Often 
these are capable of remedy through 
routine changes or decisions, once 
they are identified, but typically 
they do not become identified by the 
t^articipants to and in them. 

I should also like to recommend 
to you two other immensely useful de- 
vi.ces developed at the University of 
Minnesota, one of them being an in- 
stitutional research position I ful- 
filled. This was a function, really, 
as an administrative "trouble-shooter " 
acting for, in that case, the Academic 
Vice President. It was my job to pro- 
vide that official with information 
about matters concerning which he had 
to make decisions. These included 
such things as the student union space 
problem already mentioned, checking 
facts offered by departments in budget 
and special requests, assisting in 
various internal surveys of departmen- 
tal operation, plant use, etc. Since 
I was attached to his office as an as- 



sistant and not identified with any 
department, it was assumed, I hope 
rightly, that my observation? might be 
more unbiased than those offered by 
individuals pleading for their own 
causes, and that information I devel- 
oped might represent facts uncolored by 
idiosyncratic viewpoints. I do know 
that that function proved sufficiently 
valuable that it was maintained for 
several years and in tVat time broad- 
ened in scope. 

The other Minnesota device is ac- 
tually not a matter of institutional 
research at all, unless an institution 
doesn't have one: a manua 1 of oper - 

ating procedures . This is simply a 
set of lithographed loose-leaf note- 
books kept in all administrative and 
departmental offices offering informa- 
tion to anyone who needs it as to how, 
where, when, and why to do anything 
necessary within the university--hiro 
a secretary or a professor, purchase a 
typewriter or an accelerator, take n 
leave or resign, etc. While this may 
seem an elementary codif ication--if 
your institution has one— I can only 
assure you, speaking as a member of an 
institution which doesn't, that endlcs? 
waste and inefficiency, not to mention 
rumor and misinformation, is engenderec 
if you don't. 

4. "Faculty Paranoia " with Regard 
to Central Administration 

A fourth, and, I am inclined to 
believe, vitally pressing area for in- 
stitutional research with regard to 
non-academic personnel is one I can 
only bring up by defining central ad- 
ministration as "non-academic" for the 
purpose of talking about it. I refer 
here to what I call "faculty paranoia" 
with regard to central administration 
which I have found endemic in and de- 
vitalizing to every university I have 
ever visited or with which I have ever 
been associated. Judging from my ex- 
perience in study of different insti- 
tutions, this seems to be differential- 
ly distributed among them in degree of 
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intensity but absent novhere that I 
know of. I have some guesses about 
its causes but am far more sure of 
its consequences. 

I should like to make one thing 
clear at this point. X have personal 
experience^ as student or faculty \em- 
ber, with only four institutions: two 

small colleges and two large univer- 
sities. The faculty paranoia I per- 
ceived — suspicion^ aggression and 
hostility — toward central administra- 
tion at the two small colleges appears 
to have been eminently justified by 
the attitudes^ behaviors^ and policies 
of those administrations. (These of 
you not familiar with such situations 
might read Malamud's novel, A New 
Life .) The paranoia among the facul- 
ties of the universities with which I 
have been associated appears to me to 
be largely unjustified by what I know 
of their administrations. This is not 
to say, however, that it is not the 
fault or responsibility of those ad- 
ministrations. 

Faculty paranoia about administra- 
tion appears to be a continuing prob- 
lem in American universities and one 
which is unresolvabie by the faculty 
itself. It is, I think, largely the 
consequences of misinformation about 
policies, procedures and administra- 
tive decisions, and of lack of infor - 
mation about them. Now nature abhors 
a vacuum, and where there is a vacuum 
of intelligent information, rumor and 
anxiety will rush in to fill it. Pro- 
fessors, indeed I suppose any class 
of intellectuals, are talkers and 
criticizers and hypothecators. 

Most of you have been in or as- 
sociated with the armed services and 
remember how rapidly military rumor 
mills spill forth. Imagine, then, a 
situation where the structure is 
staffed, not with common soldiers, 
but with trained professionals at 
speech and supposition, already social- 
ized through years of intensive indoc- 
trination to feel themselves under- 
paid, put-upon, and insufficiently 



respected by the world. This picture 
describes, of course, one aspect of the 
university. Under these circumstances, 
any action by an administrator left 
unexplained, any policy decision dis- 
advantageous to some party, any unpop- 
ular decision, will inevitably be 
siezed upon as yec another evidence of 
the stupidity, ^f not downright venal- 
ity, of the decision-makers. It has 
been my experience with professors 
that, despite their training, they are 
not given to attempting to understand 
the other's view when it imposes on 
their own wishes or desires or dreams, 
and that, further, they are seldom 
given intelligent explanation of why 
the administrator's view must perforce 
often be different from their own. It 
is a faculty commonplace that the best 
way to ruin a good professor is to 
make him into a dean, but the reasons 
for this apparent metamorphosis are 
rarely analyzed rationally. Many pro- 
fessors not only do not understand but 
have never had explained to them the 
wider "constituencies" an administra- 
tion has to serve, the political and 
financial and intellectual pressures, 
so alien to them, that shape the uni- 
versity, the often crucial art of com- 
promise. 

For this reason, then, I say that 
faculty paranoia, with all its waste 
and Inefficiency and pain, is the re- 
sponsibility of the administration to 
exorcise. It must do this, first of 
all of course, by not being venal in 
its relations with its scholars, though 
I think this rare at major universi- 
ties. But, this elementary condition 
met, there is then a pressing need for 
central administration to explain it- 
se‘’f through speech, through writing, 
and through personal contact, to its 
faculty — to inform the faculty honest- 
ly and fully of the considerations that 
impel decision and, when possible, to 
consult before decision with the fac- 
ulty. Only in such ways may trust and 
widespread support be engendered. 

The reasons why the elimination of 
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faculty paranoia about administration 
is desirable seem self-evident, but 
may be worth mentioning very briefly. 
The first is that it is painful to 
both the faculty mrmber and the ad- 
ministrator-- to the former because 
11 causes him to live ia anxiety, to 
the latter because it neans his every 
■Action is suspect by the community he 
-erves and his every motive maligned. 
Tot; second is that it is inefficient, 
causing faculty men to waste motion 
defending themselves against perils 
which do not exist and administrators 
to waste time in campus politics to 
make palatable actions which should 
need only be described to be adopted. 
The third is that it is wasteful of 
time and talent since it defines as 
real that which is not, thus direct- 
ing men’s energies and eff-srcs toward 
objects which do not exist and away 
irom what might otherwise be possible 
for both the faculty and the adminis- 
trator. 

Graduate Students 

The third major area in which I 
was asked to discuss needed institu- 
tional research was that of graduate 
students, and I turn to this point 
now because it follows so neatly upon 
the last. 

1. Paranoia 

There is, it seems to me, far more 
dangerous paranoia endemic among grad- 
uate students than even among their 
mentors on the faculty. This observa- 
tion comes as no surprise, I am sure, 
to most of you- Almost anyone who 
has been in the graduate school has 
experienced what it must be like to 
suffer paranoid delusions. The reasons 
why this problem should be so ubiqui- 
tous, I suspect, are found in the 
status and structure of graduate edu- 
cation: the graduate student, already 

past the period of education consid- 
ered normal and desirable in our soci- 
ety, beset from every hand with cul- 



tural values demandin« that he m&ko 
his way in the world while tane- 

ously consuming all he can of its 
goodies, has laid his life upon the 
line in a serious intellectual commjt- 
menl to something he does not yet 
clearly understand, to be competitively 
achieved in a contest the rules of 
which are cloudy, largely unknown, and 
apparently differentially applied. 

Small wonder, then, that he should be 
apprehensive and, as time drags on and 
haidships increase, become both hostile 
to his institution and suspicious of it. 
I do not, for most of you, need to des- 
cribe the effects of these cotditionc 
upon him— the anxiety, the waste motion, 
the frustration he endures, I suspect, 
further, that it contributes to the 
rather high drop-out rate at some of 
our graduate schools. 

The description of the condition, 
however, suggests the means of its al- 
leviation, and it is a mystery to me 
why such remedies are so infrequently 
applied: again the answer is in infor- 

mation. The student should be r'..ali. - 
tically apprised of the rules and ex- 
pectations of tht‘ graduate school and 
status of his department and of his in- 
structors, He should bo told what it 
means to be a t'-* s:.udent, the 

standards of performance which will be 
expected of him a^.d hiv*’ J hey may b»* :net, 
and constantly •. ivcour.ijiod to I'ring his 
questions and problems before the only 
persons whose opinions have any meaning 
to him: his faculty. 

2* Limitation of Output by Graduat.- 
Student: Peer Groups 

A second problem the investigation 
of which I would urge may not be un- 
related to the first! the limitation of 
output by graduate student peer groups. 
At the time i took my doctoral examina- 
tions, the number of students in my de- 
partment also taking theirs simultane- 
ously was eight or nine. We had worked 
and played together for some years and 
naturally fell into the habit of study- 
ing for examinations together. As the 
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appointed date approached and our anx- 
iety levels increased; we began to 
quiz eech other, instruct each other 
in areas where one was weak and one 
was strong, and in other ways define 
the coming situation as one in which 
V would be *'our group against the 
faculty.” We even went so far as to 
ccmpose and deliver to the chairman, 
when the exams were over, our critique 
of them. As might have been expected 
from such a situation the variation 
in our answers to the general ques- 
tions was extremely small. My own 
professor remarked to me that while 
ve had all passed the general exams, 
any one of us might as well have 
taken them for the group since we 
gave what amounted to identical an- 
swers, none of which revealed very 
much beside industrious memorization 
and an abiding desire to avoid ex- 
posing our intellectual processes to 
review. 

Since that time I have heard a 
sufficient number of similar anecdotes 
to realize that the competitiveness of 
graduate education may all too often 
have the effect producing, when com- 
bined with the rational and irrational 
anxieties of the graduate student, a 
deliberate, although unconscious, 
limitation on the productivity and 
imagination of the student. "Rate- 
busters” are seldom welcomed by stu- 
dent peer groups. 

Under present circumstances this 
phenomenon, if widespread, should be 
intolerable to the university. Nothing 
should be permitted to stand in the way 
of giving our students the finest 
training we are capable of, not even 
their own neuroses and our ineffec- 
tive mechanisms of graduate instruc- 
tion which produce them. 

3. Duration of G raduate Programs 

Again related to these phenomena 
is yet a third: the problem of the 

duration of graduate programs. Infor- 
mation on this topic is readily obtain- 
wMe from the files of the office of 



the graduate dean, yet I wonder how 
many universities know the average 
length of time it takes a successful 
student to obtain the Ph.D. from its 
various departments? Or why some de- 
partments have such longer averages 
than others? Or how degree programs 
may be speeded up without detracting 
from their value? 

4. Graduate Drop-Outs 

Similar to this would be a study of 
graduate drop-outs. Again T wonder how 
many universities know the drop-out rate 
from their various graduate programs, 
much less the reasons for the behavior? 
Or even how many realize they cannot 
afford for long not to know? 

5. Institutional Concomitants of 
Graduate Success and Failure 

A fifth topic for study would be 
the investigation of institutional con- 
comitants of graduate success and fail- 
ure. What characterizes depvartments 
the graduates of which are, generally, 
successful, or unsuccessful? What re- 
lations between staff and student ob- 
tain in the two? Do student attitudes 
toward the work differ with depart- 
ments; if so, how? How is the role of 
the graduate student defined in the de- 
partment with a high success rate, and 
do the average duration of degree pro- 
grams and the drop-out rate in such a 
department correlate with other phe- 
nomena? Most of these questions are 
answerable by information readily ob- 
tainable but never obtained. I suggest 
to you, to keep this brief, that it 
should be obtained. 

Summary 

I have held this platform long 
enough. To close my talk, let me sum- 
marize briefly what I have suggested 
is my view of the three imperative 
functions of institutional research In 
our universities at this time: 

1. to fill the pressing need for 
information above all, for without 
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adequate information decision is 
blind and policy helpless^ and both 
perforce dependent upon myth and 
stereotype for guidance. 

2. to maintain continuing audits 
of the actual operation of the insti- 
tution, for without this service both 
the operation of decision and policy 
and its unforeseen effects remain un- 



known. 

3. to continually reappraise , in 
staff studies, the goals of the insti- 
tution and the means it uses to achieve 
them, for without independent and ob- 
jective appraisal an institution and 
its administration always run the risks 
of mistaking words for deeds, and past 
for future. 
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RESEARCH RELATED TO DECISION-MAKING 



Algo D. Henderson 
Director, Center for the Study of Higher Education 

The University of Michigan 



DURING THE past several years ^ re- 
search has added much to our knowledge 
about the nature of decision-making 
processes in business administration 
and public administration. Very little 
has been done in relation to colleges 
and universities. Because these in- 
stitutions are different from business 
enterprise and from government^ they 
need attention in research in order to 
make improvements in their organiza- 
tion and administration. 

The behavioral sciences have been 
contributing a great deal to our under- 
standing of the nature of organization^ 
of the roles of individuals within or- 
ganizations^ and of the nature of group 
processes. Some of the theories being 
advanced have considerable relevance 
to college administration. An excel- 
lent synthesis of these theories is 
the new book by Rensls Likert^ New 
Patterns of Management . His theory 
is that higher productivity is ob- 
tained when there is general partici- 
pation in decision-making than when 
there is not. He proposes an organ- 
izational scheme of interlocking 
groups. Although Dr. Likert is ad- 
dressing himself principally to busi- 
ness administration^ his group parti- 
cipative theory has much applicability 
to college administration. 

It is basic to the understanding 
of a college or university to think of 



it as having a dual nature. A college 
on the one hand is an educational pro- 
gram. To design and operate the pro- 
gram^ it employs a faculty. Clearly 
this professional group should have a 
primary responsibility for the admis- 
sion^ 4.dvancement^ and graduation of 
students and for the design and imple- 
mentation of a program for their in- 
struction. But a college is also a 
community of persons living and working 
together and^ in this respect^ It re- 
sembles both a political community and 
an operating enterprise. Here the 
usual principles of management would 
seem to have considerable applicability. 

A college Is^ by its nature^ flat 
and decentralized in structure. Its 
primary personnel^ the faculty, is com- 
posed of professional men and women who 
think of themselves as pesi.s of the ad- 
ministrative personnel. They are more 
than mere employees and hence vertical 
notions of organization do not wholly 
apply. 

In implementing the theory of a 
flat, decentralized organization, how- 
ever, a number of problems are encoun- 
tered. One is the question of the role 
that the faculty should play in relation 
to the board of trustees. Should they 
be given representation on it as recom- 
mended by Committee T of the AAUP? To 
do so would be consistent with Likert's 
interlocking group idea. Cn the other 
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hand; American practice sharply dif- 
ferentiates the roles of the trustees 
and of the faculty. 

A second problem is being raised 
by present-day tendencies to create a 
high-level echelon of vice presidents. 
The typical plan includes four or five 
of these functional officers. They 
help to streamline and make more ef- 
ficient the administration of these 
increasingly complex institutions. 

This organization may also have dele- 
terious effects, such as removing the 
president one step further from the 
academic program and relegating the 
deans of the faculties to a position 
that is low in influence relative to 
over-all planning. The president and 
vice presidents, by reason of the close 
proximity of their offices and the fre- 
quency of their meetings, tend to make 
the major decisions for the institu- 
tion. In this group, the academic 
representatives are outnumbered by 
those concerned with business, finance, 
and public relations. 

Accompanying the latter develop- 
ment is still another one, arising 
from the increasing complexity of the 
institutions. This is the greater 
utilization of staff. When problems 
arise, they are referred to staff of- 
ficers for analysis and the presenta- 
tion of recommendations. This is, of 
course, excellent practice. Such per- 
sons, however, are becoming increas- 
ingly influential. 

Developments such as these are tend- 
ing to apply, to the college and uni- 
versity, the vertical concept of organ- 
ization — the typical line-staff struc- 
ture that is prevalent in business, the 
armed forces, etc.; and this raises 
some interesting questions because of 
the conflict with the theory as to the 
nature of a college. 

Some large universities are endeav- 
oring to protect the role of the facul- 
ties by decentralizing the several col- 
leges. A step in doing this is to es- 
tablish executive committees of the fac- 
ulty which, together with the dean, do 



most of the creative work for the on- 
going educational program. This is con- 
sistent with a principle of organization 
which says that decisions are best made 
when they are made at the level of best 
information. It also assures to the 
faculty a measure of control over the 
curriculum and student learning, espe- 
cially the short-term aspects. This 
use of faculty executive committees 
needs evaluation. 

The department, as a part of the 
structure of a university, also needs 
study relating to its productivity, its 
effectiveness, and its role in decision- 
making. The roles of departmental chair- 
men and of faculty members need study. 

An approach might be made through ana- 
lyzing the perceptions and the prefer- 
ences of faculty and chairman, respec- 
tively, relating to the use of authority. 

Faculty committees are prevalent in 
nearly all institutions and are a conven- 
ient device with which to secure parti- 
cipation. They are also notoriously in- 
efficient and consuming of the time of 
the members. Much has been learned about 
group behavior through the study of group 
dynamics, and I should suppose the find- 
ings of this research would have some ap- 
plicability in the organization and ad- 
ministration of committees. The old 
style town meeting faculty is languishing 
and may disappear. If faculty are to 
participate, presumably they will do so 
through committees, but such committees 
need to be streamlined and made effec- 
tive. We need considerable research 
about the utilization of committees. 

A new problem is now confronting 
the universities by reason of the tre- 
mendous growth of organized research. 
Contracts and grants providing research 
funds usually result in the creation of 
separately organized groups to do the 
research. The members of such groups 
may or may not be related to the cor- 
responding departments of the faculties. 
The research may or may not be inter- 
twined with the teaching. We do not 
yet know what this type of research is 
doing to the university in connection 
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with the use of personnel, the impact 
upon courses of study, and the educa- 
tion of students. 

Reverting to the subject of the 
over-all organization of the institu- 
tion, consideration needs to be given 
to the exact nature of the real organ- 
ization that exists. Two authorities, 
Pfiffner and Sherwood, suggest that 
there are five overlapping organiza- 
tions: the functional one, the socio- 

metric one, the power structure, the 
communication network, and the decision- 
making organization. The suggestion 
has been made that each df these sub- 
organizations needs description and 
analysis and then that the five should 
be charted as overlays on one another 
in order best to describe the full 
structure. For example, the usual 
organizational chart is based upon 
the functional organization. The 
sociometric one may be rather dif- 
ferent from this. The communication 
network may be very different. It 
would help in the understanding of 
the total job of administration if 
the several characteristics were 
identified and understood. 

Were there time, it would be pos- 
sible to discuss in some detail various 
other aspects of organization and ad- 
ministration that have substantial 
bearing upon the decision-making 
process. For example, communication 
is essential in any organization and 
this includes colleges, but there are 
special difficulties that arise in the 
case of a college because of the es- 
sentially verba lis tic nature of the 
role of the faculty. The incoming 
papers, memos, journals, books, etc., 
that flood the faculty member's desk 
seriously impede his examination of 
information sheets and directives that 
come from the administrative offices. 
Secondly, because of their tendency to 
congregate in offices or at social 
events and engage in discussion of 
university affairs, there is an enor- 
mous amount of informal communication 
that takes place within a college fac- 



ulty. Here one sees at work the pheno- 
menon of entropy which refers to the 
tendency of information to deteriorate 
in quality as it passes along informal 
channels. 

Another factor in any academic sit- 
uation is the presence of persons with 
considerable leadership influence but 
who are not within the line of adminis- 
tration. They constitute a part of the 
communication network but not necessar- 
ily the formally organized one. One 
sociologist has described a spiral ef- 
fect involving communication under 
which, as communication lessens, norms 
begin to vary, which in turn causes 
communication to decrease, which in 
turn widens the gap between norms. 

When this spiral effect occurs, as it 
may easily do when there is much infor- 
mal communication, it may seriously les- 
sen the formal communication and thus 
cause faculty-administrative relation- 
ships to deteriorate. Many administra- 
tors lose their leadership of the fac- 
ulty because of insufficient feedback. 
They may also not work sufficiently on 
lessening the barriers, of which there 
may be many, to adequacy of communica- 
tion. Thus, in various ways, research 
relating to communication may be help- 
ful in administration. 

Another concept that bears examina- 
tion is that of power. John R. P. 
French, Jr., has described five types 
of power: coercion, reward, legitimate, 

expert, and referent. In the use of 
authority it may be very important to 
gain an adequate understanding of each 
of these types of power. For example, 
in a college situation coercive power 
is largely ineffective. On the other 
hand, within the faculty peer group 
there would be a large component of 
power based upon expertness of author- 
ity, and a large element of referent 
power. The latter exists because of 
the tendency of faculty members to val- 
ue the opinions and judgments of pro- 
fessional colleagues in the various as- 
sociations and societies of which they 
are members. In the utilization of 
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authority by an administrative officer^ 
it becomes very important to understand 
persuasion as a mode of action--pos- 
sibly this is more true with a faculty 
group than in almost any other admin- 
istrative situation. 

Still another subject that will 
bear additional research is that of 
incentives. Chester Barnard analyzed 
incentives under the headings of mone- 
tary incentives and psychic incentives, 
giving illustrations of several kinds 
under each head. Knowing that faculty 
members are peculiarly sensitive to 
psychic incentives, we need a better 
understanding than we have of the rela- 
tive roles to be played by these two 
types of incentives in securing high 
morale and productivity among faculty. 

Many other concepts relating to 



organization and administration might 
well receive further research when ap- 
plied to the college and university 
situation. The illustration of con- 
flict and consensus, posed by John 
Millett, is suggestive of these pos- 
sibilities. If Millett is right, that 
a college is essentially a comnunity 
and that action should be based upon 
consensus, this again differentiates 
the college as an administrative or- 
ganization from other types. 

I have been discussing decision- 
making as a dynamic aspect of organi- 
zation and administration. In my 
opinion, there is a large field of 
research relating to decision-making 
in colleges and universities awaiting 
our future efforts. 
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PROBLEMS OF NEW FACULTY MEMBERS 



Harlan R. McCall 
Chairman, Department of Education 

Alma College 



EVEN THOUGH the study which I am 
to present this afternoon — Problems of 
New Faculty Members — may have somewhat 
a different complexion from the other 
studies being presented, it certainly 
is relevant to our primary concern of 
faculty satisfactions and dissatisfac- 
tions. Only if the problems faculty 
members perceive as being of importance 
to them are solved to their satisfaction 
are they going to be making their great- 
est contribution to the institutions in 
which they are serving and to higher edu- 
cation in general. 

In this day of greatly expanding 
college and university enrollments, 
calling for the addition of thousands 
of new faculty members throughout the 
United States each year, administra- 
tors are seeking ways to assist these 
new members of the faculty in resolving 
the problems they face. Administrators, 
often assuming that they know what these 
problems are, have set up various types 
of orientation and in-service programs. 
Frequently, these programs have proved 
not to be effective. 

A new faculty member may be keenly 
aware of matters that he perceives to 
be ’’problems," but these may not be 
the same as the problems a college ad- 
ministrator would believe him to have. 

The new faculty member's perceptions 
depend upon his own needs, values, and 
aspirations. In-service programs can 
be effective for him only to the exterit 



that they treat adequately those mat- 
ters that he perceives to constitute 
problems. Therefore, the primary pur- 
poses of this study were (1) to identify 
the problems that new faculty members in 
North Central Association institutions 
perceive as troublesome and (2) to iden- 
tify the administrative practices that 
new faculty members find genuinely help- 
ful in resolving these problems. (New 
faculty members were considered to be 
those full-time members of the staff 
who spent more than half-time as teachers 
and who were employed for the first time 
by participating institutions whether or 
not they had had previous teaching ex- 
perience in other institutions.) 

Information received from new fac- 
ulty members in institutions of less 
than 3,000 enrollment was analyzed fur- 
ther for the following purposes: 

1. To identify the problems that 
were most persistent, that is, 
that tended to remain unsolved. 

2. To determine the extent to 
which the problems perceived 
by new faculty members were 
(a) personal problems related 
to housing, social relations, 
etc., (b) institutional prob- 
lems related to curriculum, 
objectives, facilities, etc., 
or (c) ins tructional problems 
related to teaching techniques, 
selection of instructional 
materials, etc. 
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3. To determine if there were sig- 

nificant differences in the 
critical problems perceived by 
new faculty members that were 
related to the personal factors 
of seX; level of academic 

preparation^ or previous pro- 
fessional experiences. 

4. To determine if there were sig- 
nificant differences in the 
critical problems perceived by 
new faculty members that were 
related to the institutional 
factors of (a) slze^ as meas- 
ured by enrollment; (b) nature 
of control, public or private, 
and (c) level of instruction 
for which institutions are ac- 
credited, undergraduate or 
graduate. 

5. To determine the effectiveness, 
as perceived by new faculty mem- 
bers, of practices that were 
used extensively to help the 
faculty members resolve their 
problems, and to estimate the 
effectiveness, as judged by 

new faculty members, of prac- 
tices that might be so used. 

6. To formulate, by implication, 
suggestions for the Improvement 
of programs of orientation and 
in-service education of new fac- 
ulty members in colleges and 
universities. 

Concerned over the lack of infor- 
mation available about the new teach- 
ers' perception of the problems they 
face, the North Central Association 
Subcommittee on In-Service Education 
of Teachers of the Commission on Re- 
search and Service encouraged and as- 
sisted the Investigator in carrying 
out this study. The study was con- 
ducted by means of a four-page ques- 
tionnaire which was mailed to first- 
and third-year faculty members in 164 
North Central Association member col- 
leges and universities near the end of 
the 1959-60 college year. Copies of 
this questionnaire are available. 



The Questionnaire 

Some of you may be Interested in 
the method of constructing the question- 
naire. I shall attempt to give it to 
you in capsule form. The first draft 
of the questionnaire was constructed 
after search of the literature concern- 
ing problems of new faculty members and 
the administrative procedures used for 
helping faculty members solve their 
problems. Principles of sound ques- 
tionnaire construction, such as those 
set forth by Good, Barr, and Scates 
and Harold H. Blxler, were followed. 

In gathering Information for the 
first draft of the questionnaire, it 
was noted that problems df new faculty 
members seemed to be primarily of three 
types: (1) problems of a personal na- 

ture, (2) those pertaining to the par- 
ticular institutions in which new fac- 
ulty members were employed, and (3) 
those dealing with instructional mat- 
ters. For this reason the questionnaire 
was so constructed, listing some spe- 
cific questions under each of the three 
general headings and allowing space in 
which respondents might add other prob- 
lems. 

This first draft of the question- 
naire was revised in light of sugges- 
tions coming from the North Central 
Association Subcommittee on In-Service 
Education, to whom it had been sub- 
mitted, and results of an open-ended 
questionnaire sent to a new faculty 
member in each of six representative 
Institutions of higher education be- 
longing to the North Central Associa- 
tion in Michigan. 

After the second major draft, the 
questionnaire was further refined for 
content and clarity. Suggestions for 
alterations came from primarily the 
following sources: three new faculty 

members of Alma College to whom the 
questionnaire was submitted; several 
faculty members at Michigan State Uni- 
versity; members of the Subcommittee 
of In-Service Education of Teachers of 
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the NCA; and members of the Commission 
on Research and Service of the NCA, who 
gave their approval to circulate the 
questionnai.res to institutione and fac- 
ulty members in NCA colleges and uni- 
versities. 

The final revised questionnaire 
contained 10 specific problems of a 
personal nature; 25 of an institu- 
tional nature; and 15 of an instruc- 
tional nature. Each respondent was 
asked to evaluate each problem on the 
questionnaire, and was invited to add 
unlisted problems. 

With respect to each item, the re- 
spondent was asked to indicate whether 
the item had constituted a "problem" 
for him since he joined his institu- 
tion's faculty. If he answered that 
the item was "never a problem," he 
proceeded to the next item. If the 
item had been a problem for him, he 
was asked to indicate the following: 

(1) whether the problem still existed, 
and (2) whether it had been of "slight,' 
"moderate," or "great" difficulty. In 
short, each respondent was asked to 
evaluate each item as to its presence . 
persistence , and degree of difficulty 
as a problem for him . 

In its final form, the question- 
naire also listed 25 procedures used 
by administrators in helping faculty 
members resolve their problems. The 
respondents were asked to do two 
things: (1) to check how helpful each 

of the procedures used by administra- 
tors in their institutions had been; 
and (2) to estimate how helpful pro- 
cedures not used by their administra- 
tors might have been in helping them 
resolve their problems. 

Source of Data 

The questionnaire was mailed to 
2,747 individuals in the representa- 
tive NCA institutions, representing 
all first- and third-year faculty mem- 
bers from slightly more than half of 
the NCA institutions of less than 3,000 
enrollment and a smaller sample of 



first- and third-year faculty members 
from institutions of 3,000 or more. 

Institutions were divided on the 
basis of size: small— under 1,000 en- 

rollment; large — 1,000 to 3,000; and 
extra large- -over 3,000. Two mailings 
to individuals in the 144 institutions 
of less than 3,000 enrollment brought a 
65.7 per cent response. Only one mail- 
ing was made to individuals in the 20 
extra-large institutions; 42.5 per cent 
of this group responded. 

Drawing the Sample 

For inclusion in this study, a strat 
ified random sample was selected from 
among the North Central Association 
membership of July 1, 1959. For insti- 
tutions of less than 3,000 enrollment, 
three bases of classifications were 
utilized: (1) size, as reflected in 

enrollments; (2) nature of control, pub- 
lic or private; and (3) the highest 
level of instruction for which each in- 
stitution was accredited by NCA, grad- 
uate or undergraduate. 

Extra- large institutions, over 
3,000 enrollment, were treated as one 
group for drawing the sample instead of 
being classified further by control and 
level of NCA approval as was done in 
the smaller institutions. There were 
79 of the extra- large institutions; a 
sample of first- and third-year faculty 
members from 20 randomly selected in- 
stitutions in this classification was 
used in this study. Responses from new 
faculty members in these institutions 
were analyzed for identification of 
critical problems but no attempt was 
made to analyze the critical problems 
for institutional and personal differ- 
ences of respondents. 

Determination of Critical Problems 

The most critical problems were 
determined by referring to the responses 
on the questionnaires. The total number 
of responses for each problem indicated 
as being "great" in difficulty was mul- 
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tiplied by three; those being "moder- 
ate” by two; those being "slight" by 
one; and those "never a problem" by 
zero. The total weighted response 
was divided by the total number of in- 
dividuals responding to each question. 
The eight problems that ranked at the 
top in magnitude, or degree of dif- 
ficulty, were then defined as "critical 
problems." 

Two separate sets of critical prob- 
lems were identified- -one set for those 
faculty members serving in institutions 
of less than 3,000 students and one set 
for those serving in larger institu- 
tions . 

The eight critical problems identi- 
fied by those serving in the 144 
smaller institutions in order of degree 
of difficulty were; 

1. Acquiring adequate secretarial 
help, 

2. Finding suitable living quar- 
ters. 

3. Understanding promotion and 
salary increase policies, 

4. Lack of teaching aids, 

5. Acquiring adequate office space. 

6. Knowing what other departments 
expect of my department. 

7. Using effective discussion 
techniques in class. 

8. Developing effective lectures. 

The eight critical problems identi- 
fied by those serving in the 20 extra- 
large institutions in order of degree 
of difficulty were: 

1. Acquiring adequate secretarial 
help. 

2. Acquiring adequate office space. 

3. Understanding promotion and 
salary increase policies. 

4, Finding suitable living quar- 
ters, 

5. Knowing what other departments 
expect of my department. 

6, Knowing what other departments 
of the college teach. 

7, Fulfilling expectations regard- 
ing research activities. 

8, Knowing the institutional pro- 
cedure to be followed for cur- 



riculum revision. 

Analysis of C ritical Problems 

Responses coming from new faculty 
members in the 144 smaller institutions 
were further analyzed to determine if 
there were significant differences in 
the critical problems perceived by re- 
spondents that were related to personal 
factors or institutional factors. A 
three-stage method of analysis was em- 
ployed. Differences were declared sig- 
nificant if, and only if, they were 
significant at stage three. 

The purpose of stage one was to 
discover if there were areas of differ- 
ences in the degree of difficulty re- 
lated to personal or institutional fac- 
tors, All responses, including partials, 
were tabulated for each of the critical 
problems and distributed according to 
the seven personal and institutional 
characteristics of respondents which 
were being used as the variables in the 
study. For example, the number of 
housing problem responses was distrib- 
uted by sex of respondents and size of 
the institutions (large or small) in 
which they ware employed. For each of 
the four cells thus formed the follow- 
ing information was determined: the 

sum of the difficulty ratings given the 
housing problem; the sum of the squares; 
the mean; the sum of the squares of the 
differences; and the variance. The Jt 
test was then applied to determine sig- 
nificance; first, by personal character- 
istic of sex; second, by institutional 
characteristic of size. 

Similar information was determined 
and tests applied for personal and in- 
stitutional factors for each of the 
critical problems. 

In the above cited example, results 
at stage one gave indication that sex 
and possibly experience might be factors 
in the level of concern of new faculty 
members for the problem of housing. 
However, this conclusion could not be 
accepted without further examination of 
the data. Since no attempt had been 




made to examine the responses when all 
of the variables were the same except 
for seX; this first stage was felt to 
be a rather superficial analysis of 
differences. The sex difference might 
not be a real difference^ but a dif- 
ference that is related to experience 
or to one of the institutional factors 
such as control. A more sophisticated 
analysis was deemed essential^ leading 
to the second stage. 

The purpose of the second stage 
was to discover if there were specific 
areas of difference regarding the degree 
of difficulty of critical problems re- 
lated to personal or institutional fac- 
tors. All responses were matched so 
that all personal and institutional 
factors of the respondents were the 
same, with the total number of parti- 
cipants with each combination of 
characteristics in the possible 128 
combinations being determined. 

All of the respondents for whom 
one or mere characteristics was missing 
were eliminated from the study, re- 
ducing the number of participants to 
1,070. Chi-square tests of signifi- 
cance were run between the number of 
remaining participants and those who 
dropped out for the two elements of 
each of the seven personal and insti- 
tutional variables. Results indicated 
no significant difference at the five 
per cent level in the personal or in- 
stitutional characteristics of those 
dropped and those remaining in the 
study; therefore, the dropping of 
these did not appear to bias the re- 
sults. 

In the 128 possible combinations 
of characteristics there were only 37 
which had at least 10 respondents-- 
the number considered necessary to 
determine the degree of difficulty 
for each critical problem with any 
degree of confidence. Of these 37 
groups at least eight groups could be 
matched with eight other groups in 
which only one of the seven personal 
or institutional characteristics was 
different. There were eight matched 



groupings which could be used to study 
the control variable; eight, the size 
variable; nine, the level of approval 
variable; eight, the sex variable; 11, 
the experience variable; 11, the age 
variable; and nine, the degree variable. 

To the eight or more matched- 
groupings by characteristics, the t test 
for significance was applied to deter- 
mine if there were differences as to 
the degree of difficulty on each criti- 
cal problem. The results obtained from 
this process of analysis indicated 
whether or not any two groups which 
matched as to six of the personal and 
institutional characteristics but which 
differed on the seventh would be sig- 
nificantly different in the degree of 
difficulty on each of the critical 
problems. 

For example, on applying this stage 
to the critical problem of housing it 
was found that for four of the eight 
groups matched, except for sex, there 
were significant differences at the 
five per cent level of confidence in 
the responses by men and women, men al- 
ways expressing more concern for this 
problem than did women. 

On the basis of these findings the 
acceptance or rejection of the hypo- 
thesis being investigated still was not 
clearly evident, since, as in the above 
example, it was found that in four 
groups there were significant differ- 
ences and in four there were not. 

Since the hypothesis being investigated 
dealt with the concern of all males and 
females in the NCA institutions in re- 
lation to the housing problem, a third 
stage of investigation was used in 
which the matched groups were combined. 

The purpose of this third stage was 
to attempt to draw some general conclu- 
sions regarding the nature of relation- 
ships between each of the critical prob- 
lems and the seven variables. Two steps 
were involved in stage three. First, 
for each of the critical problems, the 
total mean degree of difficulty was 
computed for the individuals in each 
section of the institutional or per- 
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sonal factors by combining the matched- 
groupings from stage two. Second, the 
t test was applied for significance be- 
tween these two groups whenever there 
was evidence of significant difference 
at the five per cent level in stages 
one or two or when by inspection there 
was indication of the likelihood of a 
significant difference at stage three. 

The investigator realized that the 
best test for significance could be 
accomplished by matching individuals 
except for one institutional or per- 
sonal characteristic, and then examin- 
ing the differences in degree of dif- 
ficulty of these two groups. Since 
this could not be done, combining 
matched- groupings seemed the next best 
way of attempting to draw any general 
conclusions relative to the hypotheses 
being investigated. 

Concerning the housing problem, 
the differences in the expressed con- 
cern for this problem by the sexes 
held up through stage three, men view- 
ing the housing problem as causing 
them more difficulty than did the wom- 
en, Consequently, the hypothesis that 
there are no significant differences 
in the critical problems of new faculty 
members regardless of sex was rejected. 

This same three-stage method of 
analysis was used for investigating 
the responses to all critical problems. 

Indication of Persistence of Problems 

For testing the persistence of prob- 
lems, the percentage of first-year fac- 
ulty members indicating problems per- 
sisted was determined for each problem. 
To give an indication of the problems 
which seemed to dissipate and those 
that seemed to remain after three 
years, these percentages of first-year 
faculty members were compared with the 
percentages of third-year faculty mem- 
bers who indicated these problems per- 
sisted. 

Helpfulness and Use of Administrative 
Procedures 



A weighted- scale technique was used 
to determine the faculty-estimated de- 
gree of helpfulness of administrative 
procedures in assisting them to solve 
their problems. The percentage of the 
use of each of the 25 procedures was 
determined and the coefficient of cor- 
relation between the estimated helpful - 
ness and use of the procedures was 
figured. 

Conclusions from Study 

I can not attempt to give you all 
the conclusions reached as a result of 
this study, but let me just indicate a 
few which may have particular signifi- 
cance to this group: 

1, In the opinion of new faculty 
members in NCA institutions, a higher 
per cent of their problems of a personal 
nature and those associated with the in- 
stitutions in which they were serving 
were being solved to their satisfaction 
than were those problems of an instruc- 
tional nature. No instructional prob- 
lem, however, was found among the top 
three problems identified as most crit- 
ical, 

2, The orientation and in-service 
programs of NCA colleges and universi- 
ties were failing to come to grips with 
instructional problems as perceived by 
new faculty members in the NCA institu- 
tions of less than 3,000 enrollment. 
These problems persisted at a high 
level, 71,2 per cent, even with third- 
year faculty members, 

3, General predictions cannot be 
made concerning the relationship which 
might be expected between the institu- 
tional and personal factors and degree 
of difficulty of critical problems 
which new faculty members might identi- 
fy, since for no one of the institu- 
tional or personal variables was there 
a significant difference in the degree 
of difficulty evident for each of the 
critical problems, 

4, Young new faculty members have 
more difficTjslty with problems of an in- 
structional nature than do the older 
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members who join NCA faculties* In 
two of the three critical instruction- 
al problems in this study— developing 
effective lectures and lack of teaching 
aids- - these differences were found to 
be significavit at the five per cent 
level. 

5. New faculty members, who have 
had no previous college experience, 
have more difficulty with instruction- 
al problems identified by all new fac- 
ulty members as being critical than 

do those who have had previous college 
teaching experience. Differences were 
found to be significant in two of the 
three critical problems tested-- devel - 
oping effective lectures , at the one 
per cent level, and using effective 
discussion techniques , at the five per 
cent level. 

6, It was evident from the com- 
parable data of helpfulness and use 
that in many respects administrators 
in the sample NCA institutions were 
using the administrative procedures 
which new faculty members felt were 
most helpful to them in resolving 
their problems. The coefficient of 
correlation between the estimated 
helpfulness and use of the 25 proce- 
dures investigated was +.87. However, 
there were two noticeable differences 
in rankings in the helpfulness and use 
of two administrative devices. Re- 
spondents felt that light te^^ching 
loads would be particularly helpful 

in solving their problems, but that 
relatively few administrators, only 
36 per cent, used such a device. They 
rated immediate assignment to committee 
as the least helpful of the 25 pro- 
cedures; yet it was reported by 51 per 
cent of the respondents as being used 
in their institutions. 

Suggestions for Further Study 

In closing, let me suggest a few 
possibilities of further study growing 
out of this investigation that might 



be of interest to those of you attend- 
ing this Third Annual National Institu- 
tional Forum; 

1. Since critical problems of new 
faculty members were determined by a 
weighted scale technique and analyzed 
through use of a central tendency, 
there no doubt are certain problems 
which new faculty members have an in- 
clination to rate at the extremes of 
the difficulty scale as "no problem" 
or "great" in magnitude that are not 
revealed as critical by this analysis. 

By studying the extremes in responses 
instead of using a weighted scale tech- 
nique, other problems of extreme con- 
cern to new faculty members might be 
uncovered. 

2. Since no attempt was made to 
analyze the responses of those new fac- 
ulty members in institutions of more 
than 3,000 enrollment, except for the 
identification of the critical prob- 
lems, an analysis similar to that re- 
ported here for the smaller institu- 
tions might be undertaken. Should that 
be done, improved methods of sampling 
in the extra- large institutions should 
be employed. 

3. Since the methodology in this 
study involved the identification of 
critical problems by those who would 
admit to experiencing these problems, 
a more impersonal approach might be 
made by asking respondents to identify 
the presence and degree of difficulty 
of problems which other new faculty 
members experience. 

4. Since the conclusions drawn in 
this study relative to the degree of dif- 
ficulty of the critical problems as re- 
lated to the personal and institutional 
characteristics of the respondents were 
based upon a system of combining matched- 
groupings, it is suggested that the same 
procedure bight be used in any compara- 
tive study to be done in the future. As 
was evidenced in this study, other 
methods of analysis might yield quite 
different results. 
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IN THE Spring of 1959, New York 
University's Office of Institutional 
Research assumed active responsibility 
for a long- envisaged study of Faculty 
Satisfactions and Dissatisfactions, 

Dr. John Dale Russell, now Emeritus 
Director of the Office, with some gen- 
eral assistance from the Committee of 
the Elected (faculty) Members of the 
University Senate, designed a 15 page 
questionnaire for the purpose of the 
study. This instrument was distributed 
by mail to all full-time faculty mem- 
bers in May of 1959. 

The questionnaire was divided into 
six major parts, only the second of 
which presently concerns us.^ Part II 
consisted of 86 numbered items, one of 
which had three parts--a total there- 
fore of 88 conditions. Each condition 
was accompanied by a nine point graphic 
rating type scale. Respondents were 
instructed to 

indicate the extent of your satis- 
faction or dissatisfaction with the 



condition mentioned in the item by 
draw5.ng a vertical line through an 
appropriate number of the scale. 

The larger the number checked, the 
greater the extent of your satis- 
faction with the condition stated 
in the item. The number 5 should 
be used to indicate a neutral posi- 
tion, the satisfaction and dissatis- 
faction on the item being approxi- 
mately in balance, according to your 
observation and experience. The 
numbers higher than 5 indicate de- 
grees of satisfaction, the number 9 
indicating the highest degree of 
satisfaction. The numbers below 5 
indicate degrees of dissatisfaction, 
the number 1 indicating a serious 
condition that affects very adversely 
your effectiveness and your morale as 
a member of the staff at this Univer- 
sity. 



These 88 conditions in Part II were 
grouped into six clusters. Cluster A 
contained 21 items dealing with class- 



Paper delivered by Joseph Tanenhaus. For copy of Russell questionnaire see Appen- 
dix A. This questionnaire is copyrighted by John Dale Russell and used by special 
permission. 



94 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



rooms^ laboratories, research rooms, 
faculty offices, elevator service, 
maintenance, libraries, food and rest 
room facilities, and other aspects of 
physical plant. Cluster B was com- 
prised of six items concerning the 
extent and quality of the services 
provided to faculty members by secre- 
taries, janitors, graduate assistants, 
and the library staff. Cluster C con*' 
sis ted of 17 items relating to satis- 
faction with salary and salary scales, 
fringe benefits, and promotion, ten- 
ure, leave, and retirement policies 
and practices. Cluster D was made up 
of 30 items dealing with a miscellany 
of policies and practices at the depart- 
mental, school, and a 11-University 
levels of administration. Clusters E 
and F, consisting of six and eight 
items respectively, inquired into 
satisfactions and dissatisfactions 
with colleagues and with students. 

Now it would be well to stress at 
the outset that Dr. Russell was not 
especially concerned with establishing 
a general index for measuring the level 
of morale. His purpose, rather, was to 
identify in fine detail the particular 
areas in which an Institution might 
take action to improve the morale of 
various groups within its faculty. 

Nevertheless, there is strong feel- 
ing within New York University that 
Part II of the Russell questionnaire 
or perhaps some condensed version of 
it, could constitute a valid instru- 
ment for measuring changes in levels of 
morale over periods of time. In fact, 
a partial replication of the 1959 study 
is now under way. Moreover, reactions 
from persons outside the University 
suggest that the Russell questionnaire, 
if widely used, might well result in 
national norms of faculty satisfactions 
and dissatisfactions. As a direct re- 
sult of these Interests, the Institu- 
tional Research section of the Office 
of Research Services, with the encour- 
agement of Dr, Russell, recently under- 
took a methodological study of Part II 
of his questionnaire. The objectives 



of this investigation were three in 
number: 

1, to examine the interrelation- 
ships among the parameters of 
morale built into the 88 items 
constituting Part II of the 
Russell questionnaire; 

2, to identify certain key Items 
among the 88 that would account 
for most of the variance of the 
entire group and thereby make 
possible the substitution of a 
small number of items for the 
88 Items without resulting loss 
in the Instrument's value in 
measuring the level of faculty 
morale; 

3, to explore the utility of cer- 
tain class parameters such as 
rank, teaching level, principal 
function, and actual salary for 
predicting the morale level of 
a faculty. 

Cons idera t ions Influencing Choice of 
Procedures 

The choice of the procedures used 
in this study was influenced by several 
special considerations in addition to 
the usual problems of costs and the 
availability of suitable computer pro- 
grams, Each of these special considera- 
tions warrants some comment. 

In the first place, we were very far 
Indeed from being obliged to start from 
scratch. Working literally until the 
hour of his retirement. Dr, Russell had 
managed to complete a very detailed and 
perceptive analysis of many hundreds of 
the pages of tabulations that the Univer- 
sity's Data Processing Center had been 
able to provide during the Spring and 
Summer of 1961, The tabulations deliv- 
ered in time for his systematic analysis 
classified respondents to the question- 
naire by 15 categories of school, five 
of rank, and nine each of salary and 
age. Print-outs for each of these 30 
odd categories included the number of 
respondents checking each of the nine 
scale options for each of the 88 morale 
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items, as well as the sums of the 
scale scores for each item. For these 
data, Dr. Russell had calculated for 
all categories, and for some cross 
tabulations, the ranges of responses, 
medians, and arithmetic means for each 
of the 88 items, for the SS items as 
a whole, and i^r the six clusters into 
which they had been grouped. 

Among the findings which stand out 
in his analysis of the morale items are 
the following: 

1. the range of responses, even 
within most of the categories, 
tended to be wide; 

2. the mean differences among the 
morale levels of the 15 schools 
were frequently considerable; 

3. there was a positive relation- 
ship between actual salary and 
the level of morale which was 
especially noteworthy in the 
upper income brackets; 

4. the relationships between age 
and morale and between rank 
and morale were generally 
rather weak. 

Furthermore, the data suggested 
that Dr. Russell's decision, when 
drafting the questionnaire, to group 
the 88 Items into the six clusters 
previously described, was basically 
sound. Only Cluster D, the 30 item 
group labeled "Other Administrative 
Practices and Policies," obviously 
needed refinement to permit a differ- 
entiation among departmental, school, 
and all-University levels of admini- 
stration. 

The second consideration which in- 
fluenced our choice of procedures in 
studying Part II of the questionnaire 
was the problem of missing data. A 
systematic search of the punched cards 
originally prepared by the Data Proc- 
essing Center revealed that less than 
25 per cent of the respondents had 
failed to answer a majority of the 
items in every cluster, and to provide 
all of the information about rank, 
school, salary, years of service, prin- 
cipal University function (whether ad- 



ministration, teaching, or research) , 
and other data desired for classifica- 
tory purposes. On the other hand, a 
sizable percentage of the respondents 
failed “o complete every one of the 88 
items. The pattern of their non- 
responses was such that the elimination 
of all cases with missing data would 
have caused too staggering a loss in 
the size of the sample to be tolerated. 

A final consideration was the de- 
sire to pursue concurrently in the 
earlier stages of the study all three 
of the stated objectives. That is to 
say, we desired to develop more or less 
simultaneously useful preliminary data 
about the interrelationships among the 
parameters of morale built into the 88 
items of Part II, as well as about both 
the prospects for shrinkage and the util- 
ity of predicting morale levels from non- 
opinion parameters. 



Procedures^ 



The considerations just outlined re- 
sulted in the decision to proceed in 
several distinct stages. The first 
stage was to compute 10 sets of index 
scores for each respondent on an IBM 
604 calculating punch. ^ Each index was 
made up by summing a respondent's total 
scale scores for a set of items and di- 
viding this sum by the number of set 
items he completed. Five of the indices 
(cluster indices A', B*, C, E', and 
F') were almost identical with five of 
Dr. Russell's clusters (A, B, C, E, and 
F) J* These indices deal respectively 
with Physical Facilities, Personnel 
Services, Faculty Personnel Policies 
and Practices, Faculty Colleagues, and 
Students. ^ 

T^ree more (cluster indices Dj^, D2, 
and D3) were created by subdividing 
Cluster D, the miscellany of administra- 
tive practices and policies, into sep- 
arate sets dealing with departmental, 
school, and all-University administrative 
levels.^ The two remaining indices con- 
stituted a first attempt at shrinkage. 

One of these (shrinkage index S-1) was 
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comprised of the three items for which 
we hypothesized salience would be 
greatest--satlsfactlons with salary 
(item 28); office facilities (item 2 }, 
and the rooms in which teaching took 
place (item 1). The other attempt at 
shrinkage (shrinkage index S-2) added 
to the three items four others — rooms 
and equipment for research (item 3); 
the determination of courses the fac- 
ulty member teaches (item 45), the 
hours and days assigned for his classes 
(item 46), and policies for released 
time for non- teaching functions (item 
49). 

Persons who did not respond to 
item 28 (satisfaction with present 
annual salary) and at least half of 
the items in each of the 10 indices 
were then dropped frc^ the sample al- 
together. The punched cards for the 
remaining respondents were then sorted 
to eliminate those who did not provide 
all of the requested classiflcatory in- 
formation about amount of actual sal- 
ary, years at the University, age, num- 
ber of publications, and years in pre- 
sent rank. In addition, respondents 
who did no teaching at all in credit 
courses, or who did not: hold one of 
New York University's four conventional 
academic ranks (Professor, Associate 
Professor, Assistant Professor, and 
Instructor) were dropped. At the com- 
pletion of the first stage the number 
of respondents in the sample had been 
reduced from 580 to 441. 

The second procedural stage began 
with the running, on an IBM 1620 com- 
puter, of a matrix of intercorrela- 
tlons, using as variables the 10 in- 
dices, the satisfaction with present 
salary item, and the class parameters 
just mentioned. The program used, one 
written by Professor Nathan Jaspen of 
New York University's School of Educa- 
tion, also made available the means 
for each variable. As a result, a 
comparison was possible between the 
means of five cluster indices in the 
reduced sample of 441 cases with the 
means of the almost identical clusters 



A, B, C, E, and F for the original 580 
cases. No significant differences were 
disclosed. 

Analysis of the first matrix of 
Intercorrelations resulted in a decision 
to run a second and ultimately a third 
matrix of intercorrelations. The pur- 
pose of the second matrix was another 
attempt at shrinking the 88 morale items. 
Enough progress in shrinkage was dis- 
closed by the second matrix (e.g., item 
79, /genera Incompetence of students in 
your classej^/ correlates .9/ with clus- 
ter index F', and item 78 /national rep- 
utation of colleague^/ correlates .84 
with cluster index E*) to warrant com- 
paring both a new shrinkage index of 
five items and an index of all 88 items 
with each of the variables included in 
the original matrix of intercorrelations. 

The second stage of the study was 
concluded with several one-way analyses 
of variance. These were used to probe 
both the predictive value of certain 
variables, such as principal function, 
which could not be properly scaled for 
inclusion in the correlation matrices, 
and the character of certain non-linear 
relationships. 

Progress toward shrinkage during the 
second procedural stage was substantial 
enough to justify carrying this objec- 
tive of the study into its third and 
final stage, multiple regression analy- 
sis on the IBM 7090 computer at the 
New York University Computing Center. 

For this third stage we selected as in- 
dependent variables eight items (items 1, 
2, 3, 28, 51, 52, 78, and 79) v/hich stage 
two output seemed to Indicate v;ould ac- 
count for a substantial share of the 
variance of the 88 item index. To them 
we added six more (items 8, 30, 35, 43, 
44, and 72).^ The six were selected 
from the cluster (indices A', B', C, 
and D3) least strongly related to shrink- 
age Indices S-2 and S-3. Dr. Russell's 
analysis of the differences among the 
several schools served as an important 
guide for selecting the particular items 
drawn from these clusters. 

Only respondents who completed all 
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14 items could be included in the re- 
gression analysis. As a result ^ the 
size of the sample was reduced to 318 
cases. These cases were then classi- 
fied by school into three groups — 
schools having a high; moderate ; or low 
level of morale. The basis for assign- 
ing a school to a given group was 
Table II-I x I A of Dr. Russell's Pre- 
liminary Report,^ which gave the mean 
response-value by school for all of 
the 88 items in Part II. 

Regression analyses were then run 
on the 7090 computer for each of the 
three school groups and for the total 
sample. The program used was BIMD 06. 
The 88 item index served as the depen- 
dent variable, and the 14 individual 
items as independent variables. Our 
purpose in this first run was to deter- 
mine whether the 14 items would explain 
most of the variance of the 88 item in- 
dex, or whether additional items would 
need to be added. 

The results revealed a coefficient 
of multiple correlation of more than 
.90 and hence a coefficient of deter- 
mination larger than .80 for the total 
sample, and for each of the three 
school groups as well. With a fit as 
good as this, any attempt at improve- 
ment seemed an unwarranted use of re- 
sources. 

But the results did not make en- 
tirely clear how many of the 14 vari- 
ables would be necessary to explain 80 
per cent of the variance. To determine 
this, we then ordered the 14 items for 
each group and for the total sample in 
accordance with their ability to ac- 
count for unexplained variance of the 
88 item index. The program used for 
this purpose was the BIMD 09 stepwise 
regression analysis. However, BIMD 09 
does not make available the data desired 
on T levels, partial correlation co- 
efficients, and proportion of the vari- 
ance explained. Consequently we used 
BIMD 06 to rerun the items in the order 
developed by the stepwise program tor 
the total sample. The results are pre- 
sented in Tables II-V. This completed 



the third and final stage of the study. 
Discussion of Findings 

In describing the procedures used 
in this study we have already alluded 
to many of our findings. A perusal of 
the six tables in Appendix B will make 
others entirely obvious. As a result, 
in this section we shall consider only 
certain highlights in terms of the 
study's three primary objectives. 

Objective 1 , The first objective 
was to examine the interrelationships 
among the parameters of morale built 
into the 88 items constituting Part II 
of the Russell questionnaire. Table I 
reports the more relevant data developed 
in the intercorrelational analysis con- 
ducted on the 1620 computer. These data 
reveal that all eight cluster indices 
are positively related, but certainly 
not identical. In addition, each cor- 
relates rather well with the 88 item 
index. It seems likely that further 
analysis would have led to an elimina- 
tion of several of these cluster indices 
altogether v7ithout much loss in their 
ability to explain variations in the 
level of morale. The reason we did not 
move along this path was our interest 
in the identification of a small group 
of key items stated as objective II. 

Objective II . The second objective 
of this study was to attempt a shrink- 
age of the 88 items to a very small num- 
ber without resulting loss in the in- 
strument's value in measuring the level 
of faculty morale. As the data in 
Tables II to V of Appendix B show, this 
objective was achieved. Table II, which 
deals with the total sample used in the 
regression analyses on the 7090 computer, 
shows that four items alone (30, 72, 79, 
and 8) are able to account for 71 per 
cent of the variance of the 88 item in- 
dex. Adding four other items (43, 35, 

2, and 44) brings the variance accounted 
for to 81 per cent. This represents a 
multiple correlation coefficient of .90. 

Tables III to V of Appendix B show 
that the patterns for the high, moderate. 
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and lou morale schools do not differ 
dramatically from that for the total 
sample. The first eight items account 
for 81 per cent of the variance of the 
88 item index for the high morale 
group, 74 per cent for the moderate 
morale group, and 79 per cent for the 
group with the lowest morale. If two 
more items are added (51 and 28) at 
least 80 per cent of the variance of 
the 88 item index for all groups of 
schools is accounted for. Thus, 78 
of the 88 items in Part II of the 
questionnaire can be omitted without 
appreciable loss of explanatory 
power. Moreover, these 10 items 
seem appropriate for use in almost 
any type of institution of higher 
learning, whether large or small, 
public or private. 

It should be pointed out that the 
order of the variables indicated in 
the tables should not be regarded as 
a proper indication of their impor- 
tance in any absolute sense. For ex- 
ample, item number 30 (general Univer- 
sity policies about faculty promotion 
in academic rank) appears first because 
it correlates more highly (.65) with 
the 88 item index for the total sample 
than any of the other variables. But 
two other variables, item 28 (present 
annual salary) and item 35 (admini- 
strative judgment shown in making in- 
creases in the salary of individual 
members of the faculty) are almost 
as strong--. 63 and ,60 respectively. 

If either of these were substituted 
for item 30 as the first independent 
variable, 30 would have accounted for 
little more of the remaining unex- 
plained variance than they did. Any 
one of the three items 30, 28, or 35, 
when used together with 8 (faculty 
library facilities), 72 (leadership 
of the University), and 79 (competence 
of students in your classes) added in 
any order would do a fairly good job 
of accounting for the variance in the 
morale levels in any group of schools.® 



Perhaps we should also state, at 
some danger of stressing the obvious, 
that there is strong probability that 
other small groups of items, including 
items not among those we worked with, 
could be developed which would prove 
entirely satisfactory replacements for 
the entire set of 88. 

Objective III . The third objective 
of this study was to explore the util- 
ity of certain non-opinion parameters 
such as rank teaching level, principal 
function, and actual salary for pre- 
dicting the morale level of a faculty. 
Table VI of Appendix B contains cor- 
relations between the 88 item index 
and those non-opinion variables that 
we were able to scale for parametric 
analysis. The small magnitude of these 
correlations led us to conclude that 
the non-opinion parameters built into 
the Russell questionnaire do not offer 
much promise for the prediction of 
faculty morale. 

It is true, of course, as Dr. Russell 
has pointed out, that non-linear rela- 
tionships may well be involved. Some 
efforts were made to probe them via one- 
way analysis of variance. Perhaps the 
most interesting group of findings in 
these variance probes deserves mention. 
Faculty members who have administration 
as their principal function have higher 
morale levels than those whose principal 
function is research or teaching. Re- 
search persons as a group display a 
higher level of morale than those whose 
principal function is teaching. But in 
the low morale schools, where under- 
graduate teaching predominates, the re- 
lationship is reversed and the teachers 
have higher morale than the researchers. 
All of these relationships are statis- 
tically significant. 

Despite these findings about the re- 
lationship of morale to principal func- 
tion and other findings concerning rank 
and time in grade, we abandoned the 
third objective as too unpromising dur- 
ing the second procedural stage. 
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FOOTNOTES 

For a discussion of the entire 
questionnaire see John Dale 
Russell^ "Faculty Satisfactions 
and Dissatisfactions The Jour - 
nal of Experimental Education . 

Vol. 31, p. 135 (1962). 

The authors express their appre* 
ciation to Professor Nathan Jaspen 
of New York University’s School of 
Education, and to Mr. H. L. 
Walowltz, Research Associate at 
the Courant Institute of Mathemat- 
ical Sciences, for their expert 
and energetic assistance in solv- 
ing the problems related to the 
computer programs used in this 
investigation. 

The items included in each index 
may be identified by consulting 
Appendix B, Table I. 

The only differences were that 



items 1-3 were removed from 
cluster A, and item 28 from 
cluster C. 

5. See footnote 3. 

6. Ibid . 

7. John Dale Russell, Preliminary 
Report of A Study of Faculty Satis - 
factions and Dissatisfactions . New 
York University, Office of Insti- 
tutional Research (typewritten, 

p. II-S...8. 

8. OniyirftHr the completion of the 
report were we able to process a 
multiple factor analysis leading 
to an orthogonal simple -structure 
solution employing Kaiser's vari- 
max method (BIMD 17) . The 14 
variables so analyzed resulted in 
a four factor solution which in 
our judgment substantially cor- 
roborates the analysis of this 
paragraph. 
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APPENDIX A 



/ Comnlttee of the Elected Senate 
New Yoik Ifaiversity, New York 3^ N.Y. 

STUDY OF FACULTY SATISPACTIOHS AND DISSATISFACnOHS 
Questionnaire to Full-Time Faculty Manbers, Spring, 1959 



Please return questionnaire, when filled out, to Office of Institutional 
Research, 5 Washington Square North, using inter-office mail. 

Copyright 1960 

I. John Dale Russell* 



The respondent does not need to sign the questionnaire. No individual return 
will in any way be Identified with any faculty member in the rs^rt of tke study. 

In order that the tabulation of refuses may be most meaningful, it will be 
necessary to group them in accordance with certain characteristics. Please indicate 
for each of items A. to I. below the groip in which you are located. 



im 

A. Your School or College of primaiy assignment at this Ihiiverslty: Code 

College of Dentistry 01 

College of £>jgineering 02 

College of liediclne 03 

Division of General Education and Extension Services 0^ 

Graduate School of Arts and Science 05 

Graduate School of Business Administration 06 

Graduate School of Public Administration and Social Service ...... 07 

Post-Graduate Medical School .....; . 08 

School of Commerce, Accounts, and Finance 09 

Schoo]. of Education 10 

School of Law H 

School of Retailing . 12 

Ifoiversity College of Arts and Science 13 

Washington Square College of Arts and Science l4 



AU-Uhiversity, with no College, or with more than one College , . . 15 



B. Your present academic rank: 

Professor (including Research Professor) 1 

Associate Professor (including Research Associate Professor) ^ 

Assistant Professor (including Research Assistant Professor) 3 

Ihstructor — ^ 

Adjunct — ^ 

Lecturer — ^ 

Teachii^ feLlow, graduate assistant, research assistant ^ 

Other (include Visiting Faculty, Research Scientist, Associate) ... 8 

No academic rank . . . 9 



C. Your enployment status at this University: Full-time, tenure . . 1 

Full-time, non-tenure 2 

Part-time 3 



D. Please check, in the column below, the indication of 
your sex and marital status. In the column to the 
right, please check to indicate your present age. 

IBM 

Sex and Marital Status code 

Male: Single 1 

Married 2 

Female : Single 3 

Married 4 

* —mm— . 

Reproduced by Permission. 



Present Age 



30 or Less 1 

31 - 35 ^ 2 

36-^40 3 

4l - 45 4 

k6 • 30 

51 - 55 6 

56 - 60 7 

61 - 65 8 



Over 65 9 



- 2 - 

E. Check the level of the highest earned degree that you 
hold (do not Include honorary degrees): 

No earned degree held 

Bachelor's degree 

First professional degree (such as M.D. or D.D.S.) 
Master's degree or second professional degree . . 
Fh.D. ^ Ed.D., or other degree of that level . . . 
Other degree (indicate) 
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mi 

Code 

1 

“ 2 

" 3 

4 

5 

6 



F. In the column below please check the bracket that 
indicates your total years of service on the Faculty 
at this University. In the column at the right, 
please check the bracket for your annual 9-jnonths 

salary for the academic year I958-59. 9-a»nths Salary 

m Code for 1958-59 

1958-59 is my first year here 1 Below $4,000 1 

1958-59 is my second year here 2 $4,000-4, 999 2 

3-5 years 3 5,000-5,999 3 

6-10 years 4 6,000-6,999 4 

11 - 15 years 5 7,000-7,999 5 

16-20 years 6 8,000-9,999 6 

21-25 years 7 10,000-U,999_^ 7 

26-35 years 8 12,000-14,99 9 8 

36 or more years 9 15,000 and over 9 



G. Please check to indicate whether or not you hold any 
administrative title, and if so the kind of title held: 

No administrative title ^ 

Pepartment chairman or head 2 

Dean, Associate Dean, or Assistant* Dean . 3 

Other administrative title 4 



H. Please check in the list below the indication of your principal kind 
of service at this University (check only one item): 

Teaching students ^ 

Research 2 

About equal enphasls on teaching and research . . ^ 3 

Administration 4 

About equal engahasis on teaching and administration 5 

Counselling and other student personnel service . . 6 

library service 7 

Public ser/ice of a non-teaching sort ® 

Other (please indicate its nature) 9 



I. If the teaching of students constitutes any part of your se^v^ice load at 
this Uhiverslty, please indicate the academic level of the courses you 
teach (check the final item if you do no teaching): 

Ihidergraduate classes only ^ 

Graduate classes only 2 

Both graduate and undergraduate classes 3 

Non-credit classes only ^ 

Non-credit classes and undergraduate classes . . 5 

Non-credit classes and graduate classes ^ 

Non-credit classes, undergraduate classes, and graduate classes . . 7 

Do no teaching 8 

<0 
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II 

The following section of this questionnaire is designed to afford opportunity for 
the respondent to indicate the extent of his or her satisfaction or dissatisfaction 
with each of many conditions that might effect service at this Ihiiversity. Following 
the statement of each item is a scale with numbers from 1 to 9 * Please indicate the 
extent of your satisfaction or dissatisfaction with the condition mentioned in the item 
by drawing a vertical line through an appropriate number on the scale. The larger the 
number chedred^ the greater the extent of your satisfaction with the condition stated 
in the item. The nuniber ^ should be used to indicate a neutral position^ the satisfac- 
tion and dissatisfaction on the item being approximately in balance^ according to your 
observation and e^erlence. The nuzobers higher than 3 indicate d^rees of satisfaction^ 
the nvanber 9 indicating the highest degree of satisfaction. The numbers below 5 indicate 
degrees of dissatisfaction, the number 1 indicating a serious condition that c^ffects 
very adversely your effectiveness and yoiur morale as a member of the staff at this Ifai- 
versity. As an example, siQppose the first item in the list below is one that does not 
seem to affect your satisfactions in your woi& at the University one way or another; in 
that case, it should be marked as follows: 

" 1 . The rooms (classrooms and laboratories) in which you teach ... 123 ^ f 67 ^ 9 " 

If, however, you feel a moderate dissatisfaction about the rooms in whicli you teach, the 
vertical line might be drawn through the figure 3 on the scale, Oa* you can note extreme 
dissatisfaction by drawing a line through the figure 1 . If, on the contrary, you feel 
that the rooms in which you teach make a substantial positive contribution to your satis- 
factions, you could draw the vertical line through the figure 8 . Below each item a 
space is left so that you may make suggestions for improvement on the condition, especial- 
ly about those items on which you indicate some degree of dissatisfaction. If an item 
does not apply to your situation, please leave it blank, without marking any number on 
the scale. 

Dissetis- ^ Satls- 
^faction 



A. Riysical Plant Facilities . 



faction 



1 . The rooms (classrooms and laboratories) in which you teaiil 23 ^ 3 ^ 1^9 

2 . Your office facilities at the Ifaiversity 123 ^ 5 6789 



3. Booms and equipment available for your research 



123^ 5 6789 



4 . Teaching aids, such as laboratory equipment, projectors, 
slides, films, mapf 3 and charts, that are available for 
use in your classes 1234 



5. The library holdings of books, periodicals, ana other 
materials needed for students in your classes .... 

6. ®ie library holdings of books, periodicals, and other 
materials needed for effective research in your field . 



5 

1234 5 



6789 

6789 



183 ** 5 6789 



7. ©le facilities for student use of library materials in 

your teaching field 123^! 5 6789 

8 . The facilities for faculty use of the library 1234 5 6789 

9 *. Bookstore facilities for the provision of siq*plies and 

equipment needed by your students 1234 5 6789 



o 



10 . Facilities for food service for students 



1234 5 6789 
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II. A. ( continued) faction ^ ^faction 

11 • Fcusllitles for food service for msaiberB of the faicul'ty 

and adBlnistratlve staff 1234 5 6789 

12. Itoiverslty facilities for social occasiont for students 1234 5 6789 

13* Uttiversl*^ facilities for social occasions for faculty 

and adoinlstratlve staff BM9n1)ers 1234 5 6789 

l 4 . Rest xooBW and toilets for students 1234 5 6789 

15 * Rest roG-js and toilets for faculty and adoinistrative 

staff nenibers 1234 56789 

16. Elevator service , 1234 5 6789 

17 * Cleaning of classroom^ laboratories^ offices^ and 

general qsace in academic buildings 1234 5 6789 

18. Heating and ventilation of rooms you occupy 1234 5 6789 

19 * Artificial lighuing of rooms 1234 5 6769 

20 . Plant maintenance and alterations service 1234 5 6789 

21 . Plant facilities for athletic and recreational 

activities by faculty neabers . 123 4 5 6789 

B. Personnel Services 

22. !Ibe extent of the secretarial and clerical assistance 

available to you... 1234 5 6789 

23* %e quality of the secretarial and clerical assistance 

available to you 123i<- 5 6789 

24 . Bie extent of the time of gradimte assistants available 

1234 5 6789 

25. The quality of the graduate assistants assigned to voA 

with you 1234 5 6789 

26. Tte adequacy of the Janitorial service 1234 5 6789 

27. The services rendered by the staff of library .. 1234 5 6789 

C. Faculty Personnel Policies and Practices. 

28. Your present annual salary 1234 5 6789 

29 * The faculty sitLaiy scale, as detenained by general 

University policies 1234 5 6789 

30. General Ifoiversity policies about faculty pioaaotion 

in acadonic rank 1234 5 6789 
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Pl88atl8«» Satis- 

n. C. (continued) faction ^ ^ faction 

31 . General University policies about sabbatical leaves •• 123^ 5 67^9 

32 . General Ohlversity policies about tenure 123^ 5 67^9 

33* General Itolversity policies about retirement 123^ 5 67^9 

3^* Tb& proportion of the IMveirslty^s Increased resources 
that are made available for the Improvement of faculty 

salaries 123 ^ 9 67^9 

39* ^ administrative Judgment shovn in making increases 

in the salary of individual members of the faculty . • 123^ 3 67^9 

36 . Differentials that seem to eidLst In salaries 123^ 3 6 J 8 9 

37 * 9 he explication of IMverslty policies concerning the 

retirement of faculty and administrative staff members. 123 ^ 3 8 J 8 9 

36 . The adequacy of the financial provision for staff 

mei&bers who retire 123^ 3 8 J 8 9 

39* Hospitalization benefits for faculty and administrative 

staff m^bers 123^ 3 8789 

kO. life insurance benefits for faculty and sterff members . 123^ 3 6789 

hi. Health insurance benefits for feu:ulty and stcdT members 123^ 3 8789 

42. lOlicles concerning the remission of tuition fees for 

staff members and dependents 1234 9 67^9 

43 . The esetent to which funds are made available to pay 
esqpenses of attendance by faculty and staff members at 

professional meetings 1234 9^73^^ 

kh, Uhiverslty efforts to maintain socl^il life within the 

faculty groix 1234 5 678$' 

D. Other Administrative Practices and Policies. 

45 . The detexminatlon of the specific courses that the 

faculty member is to teach 1234 5 6789 

h6. The hours and days assigned for the classes you teach . 1234 5 6789 

47 . Assignment of rooms in which your classes are to be 

held 123456789 

46. Geneznl policies about the noiaal faculty teaching load 1234 5 6785 

49 . Policies followed in relieving faculty members of 
teaching loads ^ to take on research^ counselling^ 

administiative duties, or other non- teaching functions 1234 5 6789 

50. Method of selecting departmental chaiiman 1234 5 6769 



o 

ERIC 
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• 6 * 

0188 Atie- Satis* 

II. C. (continued) fftction faction 

31 . Hie personnel bolding office as departaental cbaiznan . 123 ^ 3 6769 

52. Xhe personnel bolding office as Dean of the School or 

College 123 ^* 5 6789 

33 » Prooiptness of issuance of salary checks 123 ^ 3 8789 

54. Pzoqptness in filling requisitions for si^plies and 

equipment 1234 3 8789 

33 * ProaptnesB vlth \diich hooks ordered for the library 

are nade available for your use 1234 3 6789 

36. Hie general procedures for the registration of students 1234 3 6789 

37 * Bookstore services in making available materials needed 

by students at beginning or during the semester or term 1234 3 6789 

38. Sase and readiness of co^unication between faculty 
menibers and: 

a. Administration at the College or School level. .. 1234 3 6789 

b. Administration at the level of the Vice Presidents 1234 3 6 J B 9 

c. Adminlstx'atlon at the level of the President and 

Board 1 2 3 4 5 6789 

39. Sctent of faculty participation in th» determination 

of academic policies and procedures 1 234 3 8789 

60. Esrt^nt of faculty participation in the determination 

of the promotion of faculty meahers in academic rank . 1234 3 8789 

61. Bxtent of faculty participation in the development of 

budgets at the d^artmental level 1234 3 8789 

62. detent of faculty participation in the development of 

budgets at the School and College level 1234 3 8789 

63. Sxtent of facul*^ participation in the development of 

budgets at the all-Chlversity level 123 4 3 8789 

64 . Extent of faculty participation in the determination 

of standards for student conduct 1234 38789 

63. Extent of faculty participation in the determination 
of policies concerning admission and retention of 

students . 1234 3 8789 

66 . Information available to the faculty on the general 

financial condition of the Uhlversity 1234 3 8789 

67. Information available to the faculty on the fund" 

raising policies of the Uhlversity 1234 3 8789 

6 d. Extent of faculty participation in the development 

of the building program of the University 1234 58789 
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Olssatls- 
faction ^ 



Satis- 






faction 



69* Efforts of School or OoUege administrators to 
maintain high morale and esprit de cozps among the 
faculty members 1234 9 



70. Efforts at the all-Uoiverslty level to maintain high 

morale end esprit de corps among the faculty members . 12 3 4 9 



6789 

6789 



71 * The es£tent of the administration's Interest in ^«hat 

you are doing> and in helping you to do it better ... 1234 3 8789 



72. Your general confidence in the leadership of the 
Ibiversity 



.. 1234 5 6789 

E. Faculty Oolleagues. 

73 * The general coopetence of your colleagues on the faculty 1 2 3 4 9 



74. The eictent to which your colleagues on the faculty are 

coiqpetent as teachers 1234 5 



6789 

6789 



13 * The extent to which your colleagues on the faculty ax& 
competent in research 



78. The extent to which your colleagues on the faculty are 
competent in the counseli.ing of students 



1234 5 
1234 5 



6789 

6789 



77 * The general professional attitudes of your colleagues 

on the faculty 1234 9 6789 



78. The stending of your feusulty colleagues as recognized 
scholars throughout the country in their respective 
fields ... 



1234 9 6789 



F. Characteristics of Students 



79 * The general competence of the students in your classes 1234 9 6789 

1234 9 6789 



. The general competence of the students in your depart- 
ment 



. The general competence of the students in your School 
or College 



1234 9 6789 



82. The extent to which students in your cleusses are 

achieving in accordance with their severe? abilities . 1234 9 6789 



83. ORxe seriousness of purpose of the students in your 
classes 



1234 9 6789 



84 . The previous preparation of your students for the work 

in your classes 1234 9 6789 



89. The general promise of the students you kx»w in this 



Ihiiversity . 






..1234 9 6789 



85 . The extent of socled conts^ts between the students and 



the faculty in this University 



1234 9 6789 









ni 

A. Please react to the foUovlxig list of suggested Innovations In TJblversity services 
hy indicating on the scale after each Item the probable extent of Its positive or 
n^atlve Influence on ^'our general satisfaction with conditions at this Ikilverslty. 
As before^ draw a vertical line through the nusber 5 on the scale if the effect of 
the Innovation would be neutral. Use the nisabers above 3 to indicate the extent 
of positive influence^ and the maiibers below 3 to Indicate the extent of negative 
Influence on your general satisfaction. 

Lessen Improve 

1. A referral service to professional medalists within Satis- < ^Satls- 



the lAilversity on problems concerning s 
a. PS^slcal health 



faction 



faction 



123 ^ 5 6789 

b. Mental health 1234 3 6789 

c. Legal matters (e.g.^ making a will, llablli^) ... 1234 3 6789 

d. financial matters (e.g., investments, insurance) .. 1234 3 6789 

e. Marriage and family problems 1234 3 6789 

f. Educational problems (e.g., choice of a college for 

a son or daughter) 1234 3 6789 

g. Income tax matters 1234 3 6789 

h. Travel plans 1234 3 6789 

2 . Maintenance of a IMiverslty school from the kindergarten 
through high school, to which children from faculty 

families would be admitted at low tuition rates ... . 1234 3 6789 

3 * Tuition grants for children of faculty going elsewhere 

to college * 1234 3 6789 

4 . I^idgeted funds to assist faculty members to meet expenses 

of entertaining students In faculty members' homes ... 1234 3 6789 

3 - Additional kinds of Insurance, such as: 

a* Personal liability Insurance for faculty members . . 1234 3 6789 

b. Fire Insurance for faculty members . 1234 3 6789 

c. Hold-up and burglary Insurance for faculty members . 1234 3 6789 



d. Other kinds of Insurance (please specify) '. 1234 3 6789 

1234 3 6739 



6 . Rental housing for faculty members in Uhlverslty-owned 
buildings in the vicinity of the canpus where you serve 



7 * Rental bousing for faculty members In Uhlverslty-owned 

buildings in a suburban area 123436789 



8 . Uhiversity loans to finance home ownership by faculty . 1234 3 6 7 'J y 
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III. A. (continued) 

9 * IndiCAte any other InnovatlonB in the fringe-benefits program of the 
Ohiverslty that would enhance your satisfaction with your service at this 
(diversity. 

B. Ifeder existing conditions at this Uhlversity, how could any given aao^t of 
Increased incone best be used to Is^rove faculty satisfactions and morale? 

Please indicate your opinion on the relative values of each of the policies 
suggested below, by mailing the tppropriate number on the scale following it. 

Use the higher numbers on the scale to indicate that the item would be rela- 
tively important, and the lower numbers to indicate that it would be rather 
untiq^rtant. 

Uhlm- ^ Im- 
portant ^ ^ portant 

1 . Direct Inprovement in faculty salaries 123U 5 6789 

2 . Additional or iaqproved fringe benefits for faculty ... 1234 5 6789 

3. Bqployment of more and better clerical help for faculty. 1234 5 6789 

4 . Qqployment of more graduate assistants for faculty 

members 1234 5 6789 

3. Qi>loyment of a substantial number of additional faculty 
members, thereby increasing the total number on the 

faculty 1234 5 6789 

6. Improvement of the administrative organization and staff 

of the University 1234 5 6789 

7. Inprovement of the holdings, services, and ng of the 

Uhlversity Library 1234 5 6789 

8. Lopzovement of facilities for research 1234 5 6789 

9. Inprovements and renovations of existing academic plant 
facilities, particularly classrooms, laboratories, and 

faculty offices 1234 5 6789 

10 . Construction of additional buildings for general 

academic purposes «... . 1234 3 6789 

11 . Add any other that you consider important: 
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A. Please check the statement, in the list at the top of the next page, that most 
nearly represents your opinion about the content of the college curriculum at 
the undergraduate level. If none of the listed stat«ients properly reflects 
your opinion, write out your own expression of it on the final blank line. 



D 



a 



0 



a 



n 



u 



0 



D 



D 



0 






O 



D 
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im 

Code 



X. The liberal arts are by far the most is^rtant elemeat of the 
uodexgraduate curriculum 



4 



2. Liberal arts and occig^atlonal or professional prepeuratlon are 
both desirable in the undergraduate curriculum^ but the liberal 
arts element Is more important than the occupational element • . 



7 



3* Liberal arts and occupational or professional preparation are 
both deslrcible in the undergraduate curriculum^ and it is not 
possible to say that one is more isportant than the other . . . 



6 



4. Liberal arts and occipational preparation are both desirable 
in the undergraduate currlcuJ.um, but the occupational or 
professional element is more im^rtant than the liberal arts . 



8 



3* Occipational or professional preparation constitutes by far 



the most important eluent in the undergraduate curriculum « . 
6. Add any other statement to represent your views 



3 



9 



B. Belov is a list of items representing various categories of req^nalblllty for 
the Uhiversity. On the scale following each item^ please draw a vertical line 
through the epproprlate number to indicate your opinion of what the relative 
ioportance of the item should be for this University. Use the higher numbers 
to indicate the higher degrees of Isportance^ and the lover numbers to indicate 
less ispoz-tance. 



3. Application of knowledge to life situations 1234 3 6789 

6. The solution of problems of great national and 



9 * Mcdntenance of conditions within this University that 

are comfortable and attractive for excellent scholars . 1234 5 6789 

10 . Add any others: 




1. ^e teaching of undergraduate students 



123^ 5 6789 



2. teaching of graduate students 



123^ 5 6789 



3 * The advancement of knowledge through research 
4 . Preservation of the cultural heritage .... 



1234 5 6789 



1234 5 6789 



international concern 



1234 5 6789 



7 * Maintenance of a scholarly atmo^here within this 
University 



1234 5 6789 



8 . Enhancement of the reputation of this IMversity as a 
center for the higher learning 



1234 5 6789 



o 
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IV. (continued) 

C. Belov la a list of groins to vhlch a faculty Member might feel some obligation 
for effective service In this Ohlverslty. On the scale following each Item 
please draw a vertical line through the appropriate number to Indicate your 
opinion of the relative l^^rtance of that groiqp In your obligation for erfective 
service at this University. Use tiie higher numbers to Indicate that you consider 
the groi9 to be a highly Ijqportant element In your obligation at the Uhlverslty, 
and use the lover numbers to Indicate the groi;ps that are of less or little 
lioportance. 

Uaim- ^ iB- 
portant ^ ^ portant 

1 . Ihe students In the faculty member's classes 1234 3 6789 

2 . One's colleagues on the faculty In his own department . 1234 5 6789 

3. One's colleagues on the faculty throughout the entire 

Ifalverslty 1234 5 6789 

4 . !Ihe administrative officers of the Uhlverslty 1234 5 6789 

9. The Board of Trustees of the Uhlverslty 1234 3 6789 

6. The alumni of the IMverslty 1234 3 6789 

7. Scholars throughout the world In the faculty member's 

special academic field 1234 9 6789 

8 . IhtellectualB In general in the Uhlted States and 

throughout the world 1234 9 6789 

9. Suggest any other 1234'9 6789 

). Please chedi thr bracket Indicating the number of scholarly books, moncgrephs, 
and articles published under your authorship (including collaborations) during 
the past five years. 

im 

Huaber Code 
lone 0 

1-2 1 

3 - 2 

5- 7 3 

6- 10 It 

11-13 5 

lit •“ x6 6 

17 - 19 7 

20 - 25 8 

More than 25 ____ 9 



Q 



01 



01 



Dl 



0 



IV. (continued) 
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E. In the space helov please check the proper brackets to Indicate your connection 
with and participation In professional oxBanizatlons and learned societies^ of 
state^ regional^ national^ or international scope. Use the first coluam to 
Indicate the nu^er of such organizations in which ^ou currently hold membership. 
Use the second column to indicate the number of meetings of such organizations 
you have attended during the past twelve months. Use the third column to indicate 
the nusiber of papez*s you have presented at meetings of such organizations during 
the past two years. 



Number of state « 


regional. 


national, or international 


professional 


organizations 


‘ 1. In Which Membership 2. 
Is Currently Held 


Meetings Attended 
during Past 12 Months 


3. Papers Presented 
during Past 2 Years 


Muiiber 


im 

Code 


Number 


im 

Code 


Number 


I£M 

Code 


None 


0 


None 


_ 0 


None 


0 


1 « 2 


1 


1 


1 


1 


1 


3 - ^ 


2 


2 


2 


2 


2 


5 « 6 


3 


3 


3 


3 


3 


7-8 


h 


k 


k 


k 


k 


9 - 10 




5 


5 


5 


5 


11 - 12 


6 


6 


6 


6 


6 


13 - Ih 


7 


7 


7 


7 


7 


15 - 19 


8 


6-9 


_ 8 


8 - 9 


8 


20 or more 


9 


10 or more 




10 or more 


. » 9 



F. Please list below any special awards, prizes, medals, honorary degrees, 
citations, scholarships, fellowships, or other forms of recognition for 
scholarly activities, that you have received during the past five years: 



G. Have you had any special advanced prepEiration, beyond 

the level of highest earned academic degree you hold? Yes (l); Mo (2) 
If the answer is yes, please list each kind of 
additional pr^aration and Indicate its duration: 
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XV. (continued) 

H. Flense indicate the number ot years you have spent at each academic rank 
at any Institution of collegiate grade (including present year here): 

a. Professor (including Research Professor) 

b. Associate Professor (including Research Associate Professor) .... 

c. Assistant Professor ( includi n g Resecurch Assistant Professor) .... 

d. Instructor 

e. Other rai^s^ or without academic rank 



V 

A. Please indicate your housing situation 



1. Own own home^ fully pp?d for, and live in it 

2. live in own home, but it is not fully paid for .* 3 

3. Own a cooperative apartment — — q 

4. Live in an C5>artment rented from the University — ^ 

5. live in house or s^artoent i>jnted from some one other than — 

this Ifeiversity Y 

6. Live in rented room g 

7. Share house or apartment with another family 5 

8. Indicate any other eirrangement 



B. In the first column of figures below, to the left, please check the 
bracket indicating the amount of the annual eaimlngs of your ^ouse 
(wife or husband) from emplojinent. Check the first bracket (zero) to 
indicate either that you are unmarried or that your ^ou® has no income 
from enqployment. In the second column of figures below, to the ri^t, 
please check the bracket indicating the total anniial income of yourself 
and spouse other than your own University salary. If your spouse has a 
salary from this University, include it in the figure. 



Annual Income of Spouse 
from Eh^loyment 


IBM 

Code 


Annual Income Other than 
Iftilversity Salary 


Code 


None 


0 


None 


0 


$1 . $999 


1 


$1 . $999 


1 


$1,000 - 1,999 


2 


$1,000 - 1,999 


_ 2 


2,000 • 2,999 


3 


2,000 - 3,999 " 


3 


J,000 - 3,999 


4 


4,000 - 5,999 


4 


Jt,000 - 5,999 


5 


6,000 - 9,999 


5 


6,000 " 7>999 


6 


10,000 -14,999 


6 


8,000 . 9,999 


7 


15,000 -19,999 


7 


10,000 -14,999 


•8 


20,000 -29,999 


8 


15^000 and over 


9 


30,000 and over 


_ 9 



o 
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V. (continued) 

C. To vhat extent; in your opinion, does the necessity for you to engage 
in remunerative activities outside the University interfere with y ./\ir 
scholarly work as a member of the Ifoiverslty faculty? IBh 

Code 

Hb interference from outside activities ^ 

Only slight interfe2*ence from outside activities 2 

Substanticd interference from outside activities 3 

Very large interference from outside activities 



D. How iQsny person are at present d^endent on you for support (do not 

include yourself)? 

E. How many of your children or other persons dependent on you for 

support are this year attending college? 

VI 

A. Have you within the past three yeaxs (or during youi- membership on the staff 
of this Iftiiverslty, if you have not been on the stsiff three years) received 
eng)loyiQent offers from other educational institutions or non-academic sources? 
Please dhedi: the i^roprlate response below: ILti 

Code 



1. So, I have not received any such offers in the past 3 years 3 

2. Yes, I have received one or more such offers, but have rejected them 

and am remaining at this Ifeiversity . T 

3. Yes, I have received one or more such offers, and have accepted one, 

and Rhttir therefore be leaving this University shortly 6 

4. Yes, I have received one or more such offers, and am still consider- 
ing one (or more) of them, *but have not yet decided whether to rem ai n 

at this Uhiverslty or not . . . . h 

5. Indicate any other situation 9 

B. Are you now actively seeking opportunity for a position elsewhere 

than at this University? Yes (l); If o (2) 

C. Would you welcome an offer of a position at another 

Uhiverslty? Yes_ (l); Mb (2) 

D. What factors would you. consider in5>ortant in evaluating any offer that might come 
to you, that would involve your leaving this Ifaiversity? Please rate each of the 
suggested items below on the scale following it, using the higher numbers to in- 
dicate great importance, and the lower numbers to indicate little or no impor- 
tance. Draw a vertical line through the £g>propriate number on the scale to 
indicate your response. 

portent ^ 7 portant 



1 . Substantially larger salary than that now being 

received from this Uhiverslty 1234 5 6789 

2. Fringe benefits, other than salary, such as retirement, 

insurance, tuition remission, etc 123^ 5 67^9 






114 -15- 

VI. D. (continued) gortant ^ 

3. Ol^ortunitles for research 123^ 

4. The extent of the noxinal tea<dilng load 12 3^ 

5. The- kind of library facilities available 1234 

6. The kind of classroosi; laboratozy^ and office facilities 12 3^ 

7. The scholarly r^utatlon of the Institution making offer 12 3^ 

8. The kind of housing available for the family 12 3 4 

9. Sducatlonal opportunities for children In the family . . 12 3^ 

10. Opportunity to be necu* relatives or other friends • • • 12 3^ 

11. Opportunity to live In a different city or town ... . 123^ 

12. Opportunity to live In a different part of the country . 12 3^ 

13. Opportunity to get out of university work and into 

seme non-academic organization 1234 

14. Opportunity to take on greater responsibilities and to 

render a grea-ter service to socle-ty 1234 

15- List any other: 



Im- 



^^ portaat 

56789 
56789 
5 6789 
56789 
56789 
5 6789 
56789 
56789 
5 6789 
56789 

56789 

56789 



E. Please list below the nemes of a few institutions to which you think you might 
be attracted by the offer of a salary only equal to or a little larger than that 
you are now receiving from this Itoiversity: 

IBM 

Code 



0 

0 



a 

0 

Q 

D 

0 

a 



F. Please make any suggestions as to ways in which this Uhlverslty might be made 
a more satisfactory Institution in which to carry on yo'ir scholarly activities 



. 
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APPENDIX B - TABLE I 



New York University Faculty Satisfactions-Dissatlsfactions Study? 
Matrix of Intercorrelations Among Indices Developed from Part II 

of Russell Questionnaire 





Phy. Pers. 
Fac. Serv. 
(A') (B’) 


Fac. 

Pers. 

Pol. 

iCJll. 


Fac- 
ulty Stud. 
(E’i (F') 


Dept. 

Adm. 

(»i) 


Sch. 

Adm. 


Cen. 

Adm. 

(i>i) 


Shr. 

I 

(S-1) 


Shr. Shr. 

II III 

J^-2) (S-3) 


88 

Item 

Index 


Physical 

Fac.(l) 


m 


.56 


.42 


.30 .33 


,30 


.50 


.55 


.55 


.63 


.46 


.79 


Pers. 

Serv.(2) 


.56 


- 


,38 


.32 .32 


,34 


.46 


.45 


.45 


.54 


.45 


.67 


Faculty 
PerSaPol. 
& Prac.(3) 


.42 


.38 




.18 .28 


.44 


.58 


.56 


.46 


.54 


.50 


.71 


Faculty 
Colleagues (4) 


.30 


.32 


.18 


- .44 


.34 


.32 


.27 


.25 


.34 


.57 


.49 


Characteristics 
of Studs. (5) 


.33 


.32 


.28 


.44 


.25 


.39 


.35 


,24 


.36 


.57 


.55 


Deptl. 
Admin. (6) 


.30 


.34 


.44 


.34 .25 




.62 


.53 


.34 


.47 


.67 


.60 


School 
Admin. (7) 


.50 


.46 


.58 


.32 .39 


.62 




.74 


.44 


.58 


.73 


.80 


Central 
Admin. (8) 


.55 


.45 


.56 


.27 .35 


.53 


.74 




.42 


.53 


.57 


.80 


Shrinkage 
Index I (9) 


.55 


.45 


.46 


.25 .24 


.34 


.44 


.42 


•» 


.86 


.53 


.63 


Shrinkage 
Index II (10) 


.63 


c54 


.54 


.34 .36 


.47 


.58 


.53 


.86 




.64 


.79 


Shrinkage 
Index III (11) 


.46 


.45 


.50 


.57 .57 


.67 


.73 


.57 


.53 


.64 


V* 


.77 


88 Item 
Index 


.79 


o67 


.71 


.49 .55 


.60 


.80 


.80 


.63 


.79 


.77 


- 



SAMPLE SIZE 441 



Key to Items in Each Index; for wording see Appendix A 



(1) 


Items 


4-21 


(7) 


Items 


52, 56, 58a, 62, 65, 69 


(2) 


II 


22-27 


(8) 


It 


58b-c, 63-64, 66-68, 70-72 


(3) 


II 


29-42 


(9) 


1! 


2, 3, 28 


(4) 


II 


73-78 


(10) 


It 


1, 2, 3, 28, 45-46, 49 


(5) 

(6) 


II 

II 


79-86 

50-51, 60-61 


(11) 


It 


28, 51, 52, 78, 79 
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Coef. of Determination .814 Squares Squares Value 
Multiple Corr. Coef. .902 Due to Regression 14 73.594 5.257 35.42 
Sample Size 128 Deviation about Reg. 113 16.772 0.148 

Total 127 90.366 
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APPENDIX B «• TABLE VI 

New York University Faculty Satlsfactlons-Dlssatlsfactlons Study; 
Correlations Between 38 Item Index and Certain Non-oplnlcn Parameters 



Parameters 


88 Item 
Index 


Means 


! s.D. 


88 Item Index 


“ 


5.03 


1.04 


Yecrs at imj 


.04 


4.59® 


2.02 


Amount of Salary 


.31 


5.12'* ' 


1.94 


Amount of Publication 


.09 


3.24® 


2.56 


Teaching Level 


,17 


1.01^ 


0.72 


Age 


.12 


4.34® 


1.99 


Rank 


.12 


2.87* 


1.06 


Years In Grade 


0 

• 

1 


4.13® 


3.39 



SAMPLE SIZE 441 



Scored on a scale of nine class Intervals; '°4" represented 6**10 years^ "5" 
equalled 11-15 years. 



^Of nine class Intervals^ ”5” represented $7,000-7,999, and ”6" $8,000-9,999. 
®0f the nine class Intervals, "3” represented 5-7 publications, 'V 8*%10. 



teaching level 



was scored as: 



Undergraduate only 
Mixed Grad. & Under grad. 
Gxaduate 



0 

1 

2 



Q 

Of nine class Intervals, "4" 



represented 41-45 years. 



and "5" 46- SO years. 



Rank scored as follows: 



Professor 4 
Associate Professor 3 
Assistant Professor 2 
Instructor 1 



^Actual years in grade. 
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ASSESSMENT OF FACULTY SATISFACTIONS AND 
DISSATISFACTIONS THROUGH MOBILITY STUDIES 



Robert L. Lathrop 
Research Associate 
Bureau of Institutional Research 
University of Minnesota 



ALTHOUGH THE title of this session 
is "Faculty Satisfactions and Dissatis- 
factions" 1 am not going to talk about 
the factors that do and do not lead to 
job satisfaction among academic per- 
sonnel. You^ obviously^ all have posi- 
tions in academic institutions and are 
not unaware of the factors that lead 
to faculty satisfactions and dissatis- 
factions ; at least in your own insti- 
tutions. Even if you were not a mem- 
ber of the faculty of a college or 
university, however, enough prior re- 
search exists on the subject of job 
satisfaction that a reasonably com- 
plete listing of the potential sources 
of job satisfaction and dissatisfaction 
could be made. 

The thing that you probably 
know, however, and the aspect oj 
topic that I would like to expli 
you this afternoon is the exteni 
which various sources of job satisfac- 
tion or dissatisfaction serve as a 
basis for changing professional posi- 
tions. To what degree do concerns 
about teaching loads, bases for promo- 
tion, long-run salary opportunities, 
trends in departmental or institution- 
al reputatj.on, opportunities for ad- 
vancement, relationships with col- 
leagues, retirement benefits, etc.. 




correspond with one's mobility? Is 
concern about the lack of strength in 
related fields or a breakdown in ef- 
fective coamunications within a college 
an important determinant in employ- 
ability decisions? 

We all know, I think, what the 
potential sources of faculty satisfac- 
tion and dissatisfaction are. The 
thing we usually do not know is the 
extent to which these sources are op- 
erating in more than individual in- 
stances and the impact that such fac- 
tors are having on the overall problems 
of institutional morale and staffing. 

In the next few minutes let me describe 
a series of investigations which have 
attempted to identify the degree of 
faculty concern with a wide range of 
possible sources of job satisfaction 
and their effect on faculty mobility. 

In response to numerous and wide- 
spread expressions of concern about 
potential faculty shortages In higher 
education during the 60 's and 70 's, a 
conanittee of the University of Minne- 
sota Senate decided to do a bit of an- 
ticipating. Working from the point of 
view that faculty mobility and job 
satisfaction are inversely related— 
that is the most satisfied person is 
the least likely to move— our Bureau 
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designed and conducted a series of 
four investigations exploring the po- 
tential of this Institution to attract 
and hold a top quality staff. 

In its broad context^ the attrac- 
tiveness of an institution is not a 
unitary trait but is^ instead^ a com- 
posite of the perceptions of at least 
four different groups. There are, 
first, persons who have recently been 
recruited and appointed to a faculty. 
These persons reflect the image of 
job satisfaction that an insti*-ution 
is able to project to a prospective 
employee. Secondly, there are per- 
sons who have been asked to join a 
faculty but have elected either to 
remain in their present position or 
to accept an alternative offer from 
another employer. These persons rep- 
resent something of the other side of 
the coin and, taken relative to the 
number of offers made, provide an in- 
dex of the drawing power of an insti- 
tution. Thirdly, there are individuals 
who have recently left a position (say 
at Minnesota) to accept an appointment 
with another institution. These per- 
sons represent one side of the reten- 
tive power of an institution; the 
other side being individuals who have 
recently received and rejected an offer 
from a prospective employer. Taken to- 
gether these four groups could be 
thought of as fitting into a 2 X 2 con- 
tingency table in which cne marginal 
dimension is the decision to stay or 
leave a position and the other dimen- 
sion is one institution versus its 
competition. 

Definitions of Groups 

In order to translate these four 
generalized groups into operational 
terms for our study at Minnesota, a 
number of transitional steps needed 
to be made. 

Although it might seem to the un- 
initiated that a faculty member would 
be a relatively simple survey unit to 
define, you, who are more acquainted 



with the variety cf kinds of appoint- 
ments that an institution might make, 
realize that this is not an obvious 
matter. 

After arbitrarily defining a period 
of time during which faculty changes 
would be considered (18 months just 
prior to the beginning of the study), 
a list of the persons whose appoint- 
ments had been newly approved was taken 
from the minutes of the Board of Regents. 
From this list, oersons on part-time 
appointments, instructor level appoint- 
ees also registered in the University 
of Minnesota Graduate School, and per- 
sons who had |>een promoted from teach- 
ing or research assistantships were 
deleted. The purpose of these dele- 
tions was to exclude persons whose de- 
cisions to join the University faculty 
may have been conditioned by reasons ex- 
traneous to the interests of the study. 

Of the 400 or so names identified, 
about 150 remained after all exclusions 
had been made. 

The second group in the study was 
defined by requesting d-^.ans and depart- 
ment heads to report the names of per- 
sons who had declined offers to join 
the University faculty. As you might 
imagine, in an institution where there 
are approximately 100 departments, each 
of which has a good deal of autonomy, 
we found considerable range in the pro- 
cedures used in making offers to pros- 
pective faculty members. In order to 
accommodate the wide variety of proce- 
dures used by various departments, the 
following definition was suggested: 

For purposes of this study, an 
offer shall be defined as a state- 
ment of commitment by an author- 
ized representative of your depart- 
ment or school, either spoken or 
written, such that acceptance by 
the recipient would have resulted 
in an appointment of that indivi- 
dual to a fall-time position, 
having one of /several specified? 
academic ranks. 

Ninety- three of the 95 administra- 
tors contacted, responded, 55 of whom 
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either said they had made no offers 
or that none had been refused. From 
the 38 chairmen submitting names ^ a 
total of 110 persons was Identified. 
Each person listed was mailed a four- 
page questionnaire and responses were 
obtained from all but six persons. 

The third group in the study was 
in one sense easily defined^ since it 
is relatively straightforward to iden- 
tify persons who recently resigned a 
position at the University of Minne- 
sota. On closer inspection^ however^ 
the matter is somewhat less obvious. 

Not all persons who leave a faculty 
are necessarily viewed as losses. In- 
deed, even among those who leave vol- 
untarily there are occasions when 
such departures are viewed as mutu- 
ally advantageous. In order to focus 
the attention of our study on persons 
whose departures were viewed as a 
significant loss, the following guide- 
line was prepared and sent to depart- 
ment chairmen and deans. 

Please indicate the names of former 
members of your faculty who resign- 
ed a full-time position at the rank 
of Lecturer /and abov^7, who be- 
cause of their professional com- 
petence (or potential), your de- 
partment would have liked to re- 
tain at Minnesota. 

Although this definition gave the 
department chairmen a good deal of 
latitude in deciding which names 
would be reported, the definition 
did accomplish its prime purpose— 
the identification of persons who 
the department had most wanted to 
hold and the exclusion of persons who 
represented no serious loss. Replies 
were received from all of the depart- 
ment chairmen and deans, although 
only 67 names were reported. It may 
be of some passing interest at this 
point to note that these 67 persons 
represented only a few more than half 
(587o) of the total number of resigna- 
tions submitted (N~116) during this 
time period. Questionnaires were 
mailed to each of the 67 former fac- 



ulty members and replies were received 
from 64. 

The fourth and final group was per- 
haps the most difficult to define, for 
it was composed of persons presently on 
the faculty who had received, seriously 
considered, and declined, an offer from 
another employer. In this group there 
were a number of obvious complications, 
beginning with the nebulous question of 
what is an offer, and ending with the 
equally difficult question of who, be- 
sides the individual faculty member, 
is likely to know about it. 

After some reflection it was de- 
cided that although many bona fide of- 
fers made to a faculty person may not 
be brought to the attention of their 
immediate administrators, it is pre- 
sumed that if an offer is seriously 
entertained by a faculty member, it is 
at some point discussed with his chair- 
man or dean. On the other hand, not 
all offers mentioned to administrators 
are seriously entertained. The problem 
therefore, was one of structuring a 
definition which would include offers 
which were seriously entertained, while 
at the same time excluding casual in- 
quiries. The following statement for- 
warded to chairmen and deans seemed to 
resolve the difficulty. 

Please list the names of present 
members of your departmental fac- 
ulty who have to your knowledge, 
seriously considered (but rejected) 
a job offer from another institu- 
tion or employer, ... .Please limit 
your consideration to full-time 
faculty at the rank of Lecturer 
Jot above?. 

In defining the group in this way, 
it was realized that some recipients 
jf offers might be overlooked; however, 
it was assumed that the vast majority 
of offers which came to a point of se- 
rious consideration would be included. 

Procedure and Collection of Data 

k total of 200 names was submitted 
by the department chairmen and deans 
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from vhich a 60 per cent random sample^ 
stratified by rank and college^ was 
drawn. Of the 120 persons identified 
in the sample^ 110 were interviewed. 
(The remaining 10 were either away 
from the campus or did not confirm 
having seriously entertained an offer 
during the time specified.) 

The collection of the data in 
these four studies involved the use 
of two questionnaires and two struc- 
tured personal interviews. Without 
going into the substantive details 
of our findings^ let me merely sug- 
gest the areas of satisfaction and 
dissatisfaction which our investiga- 
tion touched^ and indicate the variety 
of approaches which were used to secure 
reliable and relevant data. 

In each of the interview studies^ 
a procedure, generally described as a 
semi-structured interview^ was used. 

In this approach y the faculty member 
being interviewed is asked a broad 
open-ended question such as "What 
would you say were the reasons that 
led you to accept a position at the 
University of Minnesota?" and then al- 
lowed to respond in a relatively un- 
directed manner. After the interviewee 
has completed his voluntary statement^ 
the interviewer then asks about any key 
points not already mentioned. This 
procedure allows the investigator to 
secure opinions on a pre-selected list 
of questions^ with minimal suggestion 
of preconceived responses or priori- 
ties. 

Following each interview in our 
study^ the interviewer transcribed his 
notes which were then typed following 
a standard format. The typed trans- 
cripts were then content analyzed and 
coded. In order to give you some feel 
for the manner in which the content 
analysis proceeded^ let me take one 
item from the interview guide used 
with persons who had recently come to 
the University of Minnesota. The broad 
question asked by the interviewer was^ 
**What would you say were the reasons 
that led you to accept a position at 



the University of Minnesota?" Accom- 
panying this question was a list of 14 
different areas which were to be in- 
cluded in the response. An example of 
one such area was the attractiveness 
of Minnesota's salary offer. If dur- 
ing his voluntary statement the inter- 
viewee did not mention salary as a fac- 
tor in his decicion^ the interviewer 
was directed to ask the following ques- 
tion^ "Did Minnesota's salary offer 
play a part in your decision?" 

After reading through the 150 tran- 
scripts^ the following list of para- 
phrased but typical comments regarding 
the influence of Minnesota's salary of- 
fer on the decision to come to the Uni- 
versity was made: (1) the salary offer 

played no part in decision; (2) the 
salary offer was a disadvantage in 
coming to Minnesota; (3) moving costs 
counterbalanced any salary Increase; 
and (4) higher Twin City housing costs 
resulted in a real income loss. These 
responses were representative negative 
responses to the question of salary as 
an influence. On the other end of the 
scale were such responses as: (1) an 

assurance of regular summer teaching 
(or a 12 month appointment) made salary 
a factor; (2) the salary offer was sat- 
isfactory for an academic position (as 
contrasted with a non-academic position 
(3) long range potential at Minnesota 
was better than in another position; 
and (4) the salary represented a raise 
over my existing salary (and this was 
a factor in the decision). These eight 
paraphrased responses exhausted the 
range of comments made by the inter- 
viewees regarding the decision. 

After the codes were established 
for each area of Inquiry^ two analysts 
went through each transcript^ coding 
interviewee comments to each point 
listed. Having built the codes out of 
the responses actually observed^ It was 
net surprising that there was relatively 
little difficulty in classifying indi- 
vidual responses. As you might appre- 
ciate^ there was a certain amount of 
squeezing done with some, responses to 
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fit them Into one of the existing 
codes; however ^ whenever the inter- 
viewer felt that none of the exist- 
ing codes really satisfied the intent 
of the interviewee^ a new code was 
added. 

The coding process was^ in effect^ 
a shorthand procedure which allowed us 
to conveniently summarize a. great va- , 
riety of individual responses to a 
series of rather complex questions. 

The validity with which this coding 
was done^ I believe^ is reflected in 
our ability to work backward from code 
sheets to find exact quotations which 
could be used to illustrate points in 
our report^ and by the fact that in 
several instances^ where interviewees 
had requested to see the typed and 
coded transcripts of their remarks ^ 
the accuracy of our translation was 
supported. 

Analysis of the questionnaire data 
proceeded in essentially the same man- 
ner as for the interview data^ with 
the exception that several of the items 
on the questionnaire were prestructured 
from ideas suggested by the earlier 
analysis of interview responses. 

In addition to the free response 
data from the interviews and question- 
naires; a number of check lists and 
rating scales also were used. Where 
similar factors (e.g. , departmental 
prestige and perceptions of col- 
leagues) were approached from both 
the check lists and the free response 
procedures^ the agreement between the 
two sets of results was impressive. 

The only suggestion that respondents 
might be deliberately "arranging" 
their coGBatnts came, as you might pre- 
dict, in regard to salary where inves- 
tigators frequently fvSlt, from the 
totality of the interviews, that sal- 
ary considerations were more important 
than were reported. In most other mat- 
ters, however, the interviewers' sub- 
jective appraisals of the responses of 
the interviewees supported their valid- 
ity. 



Implementation of Findings 

Moving now from the condisct of the 
study and its findings, which 1 believe 
are fairly well descrik».d in the report 
of the study, ^ I should just like to 
comment a moment or two about the im- 
plementation of our findings about fac- 
ulty satisfactions and dissatisfactions 
within the University. 

It is difficult, of course, to know 
the full implications of a study like 
this. A number of changes have taken 
place since the publication of our re- 
port, however, which coincide very 
closely with recommendations made by 
the faculty committee sponsoring the 
study (e.g., improvement of insurance 
and retirement programs, relaxation of 
nepotism rules, etc.). In addition, 
the University Senate has recently ap- 
pointed a permanent committee on fac- 
ulty welfare which has taken a number 
of items for its agenda from the report 
of our study. 

Apart from the implications which 
our study may have had £er tangible 
change within the University, a number 
of respondents said they were encour- 
aged by the fact that someone in the 
University was interested enough in 
their opinions and problems that th^y 
would initiate this kind of study. 

Even if no other obvious changes ever 
took place as a result of this study, 
the mere fact that the study was done 
suggests to faculty that here is a cli- 
mate in which faculty opinions are 
likely to receive a hearing. This may, 
in the long run, be one of the most sig- 
nificant outcomes of this study of fac- 
ulty satisfactions and dissatisfactions. 

I should not, however, close by 
leaving you with the impression that, 
as a result of this study, all faculty 
dissatisfactions have disappeared at 
Minnesota. On the contrary, in my opin- 
ion the one factor which seemed to stand 
out as crucial in importance appears to 
have been relatively unaltered by our 
investigation — that is the role of the 
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departmental chairman In faculty nego-> 
tlatlons. It I suppose^ too much 
to expect that the behavior of depart- 
ment administrators would be appreci- 
ably Improved by simply knowing what 
factors In decisions are viewed as 
Important and what manner of negotia- 
tions are typically effective or In- 
effective, There was no question^ how- 
ever^ that the key figure In setting 
the tone of a department Is Its chair- 
man^ and the Interaction of this per- 
son with his faculty Is probably the 
most Important determinant of faculty 



satisfaction^ dissatisfaction, and 
morale. 
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STUDENT FOLLOW-UP STUDIES - 
A RESEARCH DESIGN 



Lewis B. Mayhew 
Professor of Education 
Stanford University 



PERHAPS THE best indication of the 
significance of follow-up studies of 
college students and of the state of 
present knowledge about former students 
is a series of questions and the rhetor- 
ical question of "How many of the ques- 
tions could we in this room answer for 
our own institutions?" 

1. How do our graduates differ 
from non- graduates ten years after 
college with respect to earnings ^ 
use of leisure^ political habits^ 
religious beliefs^ use of college- 
inculcated skills and emotional 
development? 

2. What elements within a colle- 
giate educational experience seem 
related to the activities and be- 
havior of former students? 

3. What opinions do former students 
have about their collegiate expe- 
rlence^ instruction received or 
counsel obtained? 

4. What vocations do college grad- 
uates follow and what relationship 
do these have to subjects studied? 

5» What are the vocational careers 
of former college students who did 
not graduate as compared with those 
who did? 

6. What differences are there be- 
tween the post-collegiate lives of 
people who attended one kind of an 
institution and those who attended 
different types? 



7. In che college-educated popula- 
tion which appear to be the most 
significant influence on behavior; 
pre-college, college or post-college 
experiences? 

8. What are the differences be- 
tween former students who do and do 
not help support the institutions 
from which they graduated? 

9. How do recent graduates differ 
from older graduates with respect 
to attitudes, beliefs, vocations 
and behaviors? 

These are all kinds of questions 
which a business would seek to answer 
regarding its product, yet which colle- 
giate education has, with a few marked 
exceptions, failed to ponder. Or if 
an Institution has sought answers, it 
has done so only for a restricted class 
of questions. Virtually every spokes- 
man for public junior c'^Heges claims 
that the technical-vocac. ^al part of 
the curriculum is significant, yet data 
are available for only those students 
who transfer to a four-year institu- 
tion. Liberal arts colleges typically 
send a relatively small proportion of 
their students to graduate school yet 
these are the only ones about whom the 
institution has descriptive follow-up 
data. 

The purpose of this paper is to 
present some ideas for a research de- 
sign for foliow«up studies. As a 
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background for such a presentation it 
may be well to examine some studies 
which have been made so that both the 
strength and weakness of those efforts 
can instruct future attempts to under- 
stand the product of collegiate educa- 
tion. 

Past aitd Present Follow-up Studies 

One of the most widely quoted 
follow-up studies was that done by 
C. Robert Pace and described in They 
Went To College , University of Minne- 
sota Press, 1941. Pace used an at- 
tractively produced questionnaire of 
fifty-two pages to obtain information 
from 951 former University of Minnesota 
students who entered college in 1924, 
'25, '28 and '29. This revealed the 
rather disturbing finding that there 
were few if any differences between 
students who graduated and those who 
did not graduate with respect to civic 
activities, use of leirure, home and 
family living, and occupations. Pace 
himself has subsequently remarked 
that while he was generally satisfied 
with the study as he made it, he 
would not attempt another until newer 
and better methodologies were available 
for such an inquiry. 

A decade later Ernest Haveman and 
Patricia West used the same title, 

"They Want To College," to report on 
what at first was intended as a study 
of readers of Time magazine but which 
eventuated as a study of college grad- 
uates. Their study was based upon 
questionnaire replies from 9,064 col- 
lege graduates believed to be repre- 
sentative of all graduates of American 
colleges and universities. Since the 
authors received a fifty-nine per cent 
return of the questionnaire this may 
be a questionable belief; however, the 
returns were typical of the majority 
of questionnaire studies. If the 
sample is even reasonably representa- 
tive, the report reveals some inter- 
esting but not too surprising things 
about college graduates. It is the 



school attended, not the courses at- 
tended, which is most highly related 
to post-college earnings. Those who 
worked their way through college earn 
less as adults than those who were 
supported by their parents. Generally, 
except for the very recent college grad- 
uate, the respondents were conservative 
in their political and economic outlook. 
They are evenly divided in their be- 
liefs about race with about a third be- 
ing tolerant, another third prejudiced, 
and the last third ambivalent. 

Perhaps the biggest weakness in the 
entire study lies in the treatment of 
the data. Thus it finds that those stu- 
dents who were most conscientious about 
their school work tend to earn higher 
salaries later on than do the all-round 
students, the big men on campus or 
those who just existed. These figures 
could only be meaningful had they been 
analyzed in the light of the kinds of 
colleges related to subsequent income. 

It might be that the prestige colleges 
demanded more work but that the rele- 
vant factor was the prestige of the in- 
stitution. 

Two different kinds of follow-up 
studies are reported by Paul L. Dressel 
and his associates in Evaluation In The 
Basic College . The first, conducted by 
means of correspondence and telephone, 
attempted to discover why students in 
good academic standing dropped out of 
Michigan State University. According 
to this study, desire to transfer to 
another school led the list of reasons, 
and about a third of the drop-outs 
hoped to return to M.S.U. It was the 
implication that possibly sixty per 
cent of drop-outs in good standing 
might be expected ultimately to finish 
their education; this implication led 
to later studies of this matter. The 
second study was one which was done 
routinely each year to determine the 
attitude toward the program of general 
education of all students who graduated 
that year. A brief, eight item question 
naire was sent to every graduate within 
a week after commencement. Slightly 
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over fifty per cent of chose sent 
the questionnaires returned them each 
year. In general the results were 
supportive of the separate basic col- 
lege and of the required program of 
general education but critical of the 
teaching and of the examination sys- 
tem. 

As part of its continuing evalua-' 
tion of itself, St. Scholastica made 
an elaborate questionnaire study of 
all of its graduates after fifteen 
years of collegiate existence. The 
results, presented in The First Fif- 
teen Years , were used to refine and 
reform the program of the college. 

To determine whether or not the re- 
forms were effective, a similar in- 
quiry was made ten years later of all 
of the graduates who finished college 
during that period. Both studies re- 
lied on richly illustrated question- 
naires. Typical of its findings are 
general satisfaction with the educa- 
tion St. Scholastica provided but 
general dissatisfaction with recon- 
ciling ethical and religious beliefs 
taught by the college with the press 
of contemporary culture. 

A different method for follow-up 
study is involved in Jeanette H. 
Eilenberg’s Brooklyn College - Class 
Portrait 1953-57 . She began collect- 
ing data — questionnaire responses and 
interview impressions — for all fresh- 
men in the class of 1957 when they 
entered school and at periodic inter- 
vals throughout the succeeding four 
years. She concerned herself with 
such things as parental education, 
religion and socio-economic charac- 
teristics, student use of time, cul- 
tural preferences, and attitudes to- 
ward the college. Although Brooklyn 
is atypical to the majority of American 
colleges, the results of this study, 
when compared to the results from many 
such studies reported by Philip E. 

Jacob in Changing Values In College , 
reveal the Brooklyn- grown college 
student and graduate to be remarkably 
similar to his counterpart found out- 



side the ii.etropolitan New York area. 

Perhaps the prototype for inten- 
sive studies such as the Brooklyn in- 
quiry is the study conducted by 
Theodore M. Newcomb of the students 
from several of the early classes at 
Bennington College, Bennington, Vermont. 
The results of the first part of the 
study are reported in Personality and 
Social Chang e and are based on records — 
testing and annual questionnaire data — 
for all girls in the class for each year 
in which they were in school. The over- 
arching finding is that student politi- 
cal attitudes changed enormously during 
the four years at Bennington. Current- 
ly the same women are being studied 
tvjenty-five years later by means of an 
intensive questionnaire and interview 
(some lasting four hours or more). The 
tentative findings, although not as yet 
published, reveal the Bennington women 
to have retained the changes in attitude 
which took place during their collegi- 
ate years. Although they represent a 
segment from the socio-economic spec- 
trum which is normally conservative and 
although their husbands are inclined 
more often than not to be Republican, 
these women tend toward liberalism and 
toward membership in the Democratic 
party. 

More modest in scope and represent- 
ing a different facet of follow-up 
studies is "The Study of Yale Club of 
New York Awardees - Classes of 1954-63." 
This study was based on the institu- 
tionally recorded data for those Yale 
graduates selected for this honor, 
which goes to those having had the 
highest freshman year scViolarship 
records. Two- thirds of those receiving 
the awards came from public schools. 

They had high predictive indexes when 
they entered Yale and their subsequent 
performance compared favorably with 
their freshman records. Paul S. Burnham 
also studied the relationship between 
"Academic Success and Career Choice," 
College Board Review , Fall 1961, pp. 22- 
23. Those graduates who as students 
earned the highest academic records 
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weTG more likely to have had military 
experience as commissioned officers, 
taken advanced degrees, published more 
books and articles, and entered the 
professions more frequently than were 
those who ranked at the bottom of 
their class. The data upon which the 
comparisons were based were culled 
from reports from class histories. 
However, comparisons were also made 
between college achievement and the 
predictive index established for ad- 
missions purposes. This revealed that 
the high achievers had had high pre- 
dictive indexes. 

Possibly the most elaborate follow- 
up studies to have been conducted are 
those of Vassar students. Three dif- 
ferent classes were retested with a 
test battery either three or four 
years after graduation. The instru- 
ments used were the California E and 
F scales, the Vassar Social Maturity 
Scale, and the Tolerance Scale of the 
California Psychological Inventory. 

Most of these alumnae were tested 
after arrangements were made by cor- 
respondence but a few for each class 
were tested at alumnae reunions. The 
results showed many things, one of 
the more important of which was the 
differences in alumnae depending on 
when they were in school. Whether or 
not these were differences while in 
school is unfortunately not known. 
(Maivin E. Freedman, ’’Studies of 
College Alumni,” in Nevitt Sanford (ed) 
The American College .) 

The Center for che Study of Higher 
Education at the University of Cali- 
fornia, Berkeley, is conducting a num- 
ber of studies which are follow-up in 
nature. In one, to be reported in 
June 1963, students from junior col- 
leges in California, Florida, Georgia, 
Illinois, Kansas, Michigan, New York, 
Pennsylvania, Texas, and Washington 
who transferred to four-year institu- 
tions are being studied. The purpose 
is to account for the marked vari- 
ability in performance of junior col- 
lege students after they transfer to 



senior institutions. The basic tech- 
nique is comparing matched pairs of 
transfer and native students. In an- 
other study 10,000 high school gradu- 
ates from the June class of 1959 are 
being followed with respect to their 
socio-economic backgrounds, cultural 
values, personality, and initial post- 
high school activities. They will be 
followed through their collegiate ca- 
reers or for a comparable period for 
those not attending college. An es- 
pecial focus of the search will be 
those background factors most signifi- 
cant in predicting success and persis- 
tence in college. 

One last example in this resume of 
some follow-up studies goes back to 
earlier types of study. A question- 
naire, with many items written to com- 
pare with a federal study, is being 
sent to all Stephens College graduates 
from the classes of 1930, ’35, ’40, 

’45, ’50, ’55, and ’60. Evidence is 
being sought as to the kinds of lives 
Stephens graduates are now leading, 
what their work experience and educa- 
tional experience has been, and what 
their most bothersome personal prob- 
lems or concerns are. The question- 
naire was pre-tested at an alumnae re- 
union and was mailed to the full popu- 
lation in March 1963. An important 
theoretical problem was resolved in 
favor of sending the questionnaire to 
all graduates rather than to a care- 
fully selected sample. 

While follow-up studies are by no 
means plentiful, those cited possibly 
provide the flavor typical of the 
genre. The Gesell studies of child 
development could have been cited as 
could the continuing studies initiated 
by Terman in the 1920 ’s. Similarly the 
growing number of inquiries into the 
nature and characteristics of college 
students might have been used to illus- 
trate particularly methodology having 
relevancy for follow-up studies. For 
example, the Rose K. Goldsen, et al . , 
analysis of What College Students Think 
and the Yale University, Division of 
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Student Mental Hygiene study of Psycho - 
social Problem s of College Men seem 
particularly timely. Perhaps in the 
discussion of the panel members some 
ot the substance of such reports can 
be aired. 

« iaknesses Past Follow-u p Studies 

There are a number of weaknesses 
apparent in the majority of follow-up 
studies of the sort considered here. 
First, there is a general reliance on 
paper and pencil questionnaires. Now 
questionnaires are favored because they 
are less expensive than other tech- 
niques, because they do provide data 
which can be treated quantitatively, 
because they are adaptable to uncover- 
ing certain kinds of information, and 
because they can be used with larger 
populations than could be studied in 
other ways. However, the exclusive use 
of a questionnaire leaves bothersome 
questions unanswered. Since typical 
responses from questionnaire surveys 
hover around the fifty per cent point, 
one is always perplexed as to the 
characteristics of those who did not 
respond. Since rarely are sufficient 
other data available to test for the 
comparability of the non-responding 
group to those who replied, one must 
always be somewhat uneasy with result- 
ing generalizations. Further, ques- 
tionnaires state things in the starkest 
prose possible to avoid ambiguity. 

This very starkness of language denies 
questioning about a number of matters 
which should be of important concern 
to college professors and administra- 
tors. B’or example, one can ask for 
Indications of vocations, salary and 
even religious practice. But how many 
of you would feel free to answer on a 
questionnaire such items as: 

1. How many times in the past five 

years have you seriously considered 

suicide? 

2. What variations of technique 

do you currently practice in your 

marital sex life? 



3. If the best advice available 
to you told you that minority 
groups moving into your neighbor- 
hood would reduce the value of your 
home, would you take an active role 
in encouraging non-discriminatory 
legislation regarding sale or rent- 
al of property? 

There are ways of obtaining answers to 
such questions but the questionnaire is 
not the best. 

In another vein, questionnaire data 
so frequently leave unanswered the dy- 
namic elements which would make the ob- 
jects of study come alive. Thus one can 
get estimates of the number of books, 
records, paintings, and the like found 
in the home. Yet the quality of these, 
the uses to which they are put, the in- 
tensity of feeling about them can never 
be assessed by such a manner. A long 
time m'}mber of a book club may have sev- 
eral thousand volumes of books in his 
personal collection just as a university 
library may have several million. Know- 
ing this is important, but one would 
also like to know whether or not the in- 
dividual has a passionate or even erotic 
feeling toward his books or whether the 
books in the library are actually used 
and if so how. All of this is not to 
deny the questionnaire an important 
place among the tools of follow-up study. 
It will and must continue to be used, but 
one would hope that so would other de- 
vices. 

A second weakness is that with rare 
exception there are unavailable data from 
the college years about graduates studied 
in a follow-up inquiry. It is only in 
the Bennington study that a major effort 
has been made to secure information from 
graduates about the same matters concern- 
ing which undergraduate data were obtain- 
ed. It may be that as follow-up studies 
become more the rule and as the truly im- 
portant factors become better known, this 
lack will be rectified. Actually, as 
officers of institutional research ponder 
the data they should collect about enter- 
ing students, at least one eye should be 
kept on the research needs for the future. 
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Now obviously the chief reason for 
collecting data concerning students 
in college is to enable wise deci- 
sions to be made about them. However, 
one could argue that data which are 
truly important for this purpose will 
also be of significance for follow-up 
studies. The most frequently used 
form for application to college pro- 
vides an abundance of information 
largely irrelevant to follow-up 
studies. In some analyses done at 
Stephens College, these data were also 
irrelevant to the problems of students 
in residence. 

A third criticism of follow-up 
studies reported to date is of their 
pre-occupation with socio-economic 
data and political belref and behav- 
ior. It is paradoxical that college 
faculties, which verbalize the value 
of the humane life, generally advise 
students by first inquiring as to what 
vocation they propose following. Then 
on follow-up studies they inquire about 
professional schools attended, the 
vocation currently being followed, the» 
kind of community in which they live, 
and their economic status. It would 
seem that if a college is interested 
in finding out about its graduates it 
ought to probe for information o” the 
variety of attitudes and behaviors 
which colleges presume to affect. 
Colleges postulate a number of objec- 
tives some of which might be (1) to 
develop in students a tolerance for 
ambiguity, (2) to develop in students 
a greater regard for self, (3) to 
develop in students an openness to ex- 
perience, and (4) to develop in stu- 
dents the ability to think critically 
about themselves and the wo~lLd in 
which they live. While ..he Vassar 
studies had begun to seek evidence 
concerning some of these, other at- 
tempts are rather difficult to dis- 
cover, Again a disclaimer must be 
injected. Socio-economic data and 
political behavior are important and 
deserve to be assessed in graduf.tes. 

But other things are equally important. 



Another weakness must be mentioned 
which perhaps can never really be cor- 
rected. This is the inability of cur- 
rently employed techniques to discrim- 
inate between collegiate and post- 
collegiate experiences in determining 
behavior. Consider if you will a 
follow-up study made of the college 
classes 'of 1940 and 1941 accomplished 
in 1950. Of the portraits, the study 
revealed which elements might best be 
attributed to the collegiate experiences 
and which to the war years. Even with 
less monumental intervening experiences 
than war, the task of deciding whether 
early years of work, of marriage, or of 
classes in the parental family were more 
or less related to adult behavior than 
were the collegiate experiences is a 
major one. The use of adequately large 
control groups might alleviate some of 
the difficulty as would also more search- 
ing techniques for gaining information. 

A fault not only of follow-up studies 
but of educational research generally is 
the lack of common terminology and the 
lack of a common set of concepts which 
could make studies from one institution 
comparable to those at another. Some 
years ago. Bloom and other university 
examiners attempted to provide a common 
language through a Taxonomy of Educa - 
tional Objectives . They published the 
first of what was expected to be a three 
part project. Unfortunately, only the 
cognitive domain has been treated, leav- 
ing to the future discussion of the af- 
fective and the psycho-motor areas. 
Recently, the Educational Testing Service 
has been studying biographical data '"orms 
in the hope of creating a common set of 
rubrics which could be used in all in- 
stitutional research studies. With the 
exception of these two efforts, nothing 
is available to aid the researcher in 
evolving instruments which will make his 
results comparable to those of others. 

It might be well for an organization, 
such as this group of institutional re- 
search workers, to begin a systematic 
standardization of terms and methods. 

If this were done, the fugitive litera- 
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turt such things as follow-up 

stuaies might provide genuine insight 
into the effect of education. 

Lastly, although certainly related 
to the previous point, follow-up stud- 
ies have been less than completely suc- 
cessful because they rarely have been 
conducted on the basis of a consistent 
theory. Freedman's studies at Vassar, 
of course, were made out of a neo- 
Freudian theory of personality and for 
this reason alone are of probably more 
lasting significance than the others. 

If an institution were to attempt a 
follow-up study, it would be well for 
considerable time to be spent on a 
theoretical formulation before attempt- 
ing to discuss technique or instrumen- 
tation. Even if the theorizing simply 
resulted in a restatement of the goals 
of general education, the resulting 
instrumentation would likely be of 
more lasting educational significance 
than would instrumentation created in 
response to the question, "Wouldn't it 
be interesting if we knew this about 
our graduates?" The more refined the 
theoretical base, of course, the better. 

Design for Follow-up Studies 

In the light of existing studies 
and a serious consideration of their 
strengths and weaknesses it is po sible 
to suggest a large design for follow-up 
studies and to suggest palliatives 
which might improve studies less pre- 
tentiously conceived. 

The first essential for a major 
follow-up study of collegiate gradu- 
ates should consist of a tenable theory 
on the basis of which hypotheses can be 
invented and ultimately tested. This 
might involve a process, such as that 
described by Dressel and Mayhew in 
General Education : Explorations in 

Evaluation , by which generally accepted 
objectives of general education were 
specified in behavioral terms. These 
Ln turn became the specifications for 
the 17 testing instruments which re- 
sulted. Or it might involve more 



complicated theories. George Stern, 
combining the concept of en /ironmental 
press developed by Murray and the con- 
cept of authoritarianism, crei^ted the 
College Characteristics Index and the 
Stern Activities Index. With these he 
has been able to assess with consider- 
able rt liability the mesh between inn?'.- 
vidual personality and the collegiate 
environment. The same rationale and 
even the same instruments have applica- 
tion in a follow-up study. The age and 
stags notions of human growth and devel- 
opment, basic to the Gesell studies of 
children and youth, also could be adapt- 
ed to provide follow-up studies a broad- 
er meaning. 

Perhaps the first element of a theo- 
retical base for a follow-up study is 
the nature of a collegiate instituL '.on. 

It is in its starkest form a social in- 
stitution designed to induct the young 
into the adult culture. It does its 
work along with other social institu- 
tions such as the family, church, mil- 
itary establishment, business community, 
and the stock market. Each has its own 
primary responsibilities which, while 
varying from time to time, are relatively 
fixed at any given time and for par- 
ticular sectors or classes of society. 
These responsibilities should be Isolated 
in the most parsimonious fashion posf^ible 
so that a follow-up study can be used to 
examine only those outcomes of education 
which are clearly relevant. The reli- 
gious beliefs and behaviors of people, 
who have spent their entire academic 
lives in secular institutions, is clear- 
ly not a subject which should concern a 
research work. Neither should an indi- 
vidual's recreational life be of concern 
unless it is a matter, as it is at the 
federal military academies, to which 
the college devotes serious attention. 

At the present, American colleges and 
universities have primary social re- 
sponsibility for preparing students for 
a vocation, for transmitting to them 
certain parts of the cultural heritage, 
for providing them with certain intel- 
lectual skills by which they can solve 





134 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



problems, and for developing a limited 
and identifiable set of tastes, values, 
and appreciations. These should pro- 
vide the substance out of which a 
follow-up study should emerge. 

Collegiate institutions function 
in a cultural environment in which the 
impact of all other experiences of the 
young very likely outweigh the impact 
of the college. Thus college students 
in the 1930 ’s were conditioned by the 
facts of a depression and of a demo- 
cratic society seeking to prevail under 
technological conditions antithetical 
to it. Students in the 1940 's were con- 
ditioned by the facts of war while those 
in the 1950 's were conditioned by social 
affluence. These forces are probably 
more operable in an individual’s later 
life than what he experiences in col- 
lege as a result of a planned colle- 
giate program. Thus studies of gradu- 
ates from the depression years would 
probably find that the economic inse- 
curities of those years are more re- 
sponsible for a middle-aged attitude 
toward security than courses taken in 
college. 

Thirdly, one can argue that all 
individuals proceed through life in a 
series of developmental stages each 
having discrete physical and psycholo- 
gical characteristics which obtain for 
relatively large numbers of a given 
age group. Gesell has described these 
ages and stages for children and youth. 

It is possible to speculate that simi- 
lar periods are .Identifiable for adults 
and that these \ riods may be more re- 
sponsible for particular behavior than 
the influences of an earlier inductive 
experience in a college or university. 
This factor has several implications. 

If an institution is interested in the 
impact it has, it should study gradu- 
ates close enough to their college ex- 
perience so that results are not con- 
taminated by later stages of develop- 
ment. Secondly, if studies are made of 
graduates in later years, and there miay 
be reason for doing so, adequate accom- 
modation should be given to the influence 



of that age or stage on behavior. 

One last element of theory should 
be mentioned. Not only are the behav- 
iors of people determined by the times 
in which they live and the stages 
through which they grow but also by 
basic personality structure which is 
formed early in life and persi«^ts. Evi- 
dence is beginning to mount which sug- 
gests that students self-select them- 
selves into and out of colleges which 
are compatible or incompatible with 
their own personal orientations. Thus 
students with a strong drive to be with 
people select a socially oriented school 
while those interested in academic work 
select other kinds of institutions. In 
very real effect, the result of a col- 
legiate experience may be much less the 
vesult of what happens in college than 
it is the result of a person's basic 
pi*rsonality which led him to a particu- 
lar college or university. 

These particular considerations may 
or may not be the proper ones. They have 
been presented to suggest that follow-up 
studies of people are both simpler and 
more complicated than has typically been 
implied. They are simpler in that only 
a limited range of behaviors are truly 
the responsibility of a college. They 
are more complicated in that they must 
account for other potent forces which 
affect human behavior. Until such fac- 
tors as these are considered, results 
from follow-up studies will continue to 
be as inconclusive as they have been in 
the past. 

Once a general point of view has 
been established, a follow-up study can 
be designed which should involve all of 
a number of devices; 

1. Intensive testing of students 
before they reach college, at var- 
ious periods throughout their col- 
legiate careers, and on into adult 
life. To this end, there is need 
for a variety of short tests of 
knowledge, attitudes, academic ap- 
titude, and even personality. In 
the case of group testing, instru- 
ments which were longer for the 
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purpose of reliability can be 
shortened. 

2. Accumulation of biographical 
data . Not only should basic bio- 
graphical data be collected but it 
should be recorded in such a way 
that the subsequent history of the 
individual can be added. Thus such 
matters as change of preference 
during college years should be re- 
corded so that the relationship 
with earlier school and life expe- 
riences can be studied. 

3. Intensive interviewing . Not 
only should students be interviewed 
but so should graduates. This is 
an expensive activity but one which 
is essential if an institution is 
truly serious about determining its 
significance in the lives of its 
former students. 

4. Cooperative effort . The in- 
sights of a variety of social scien- 
tists should be used to place what- 
ever is discovered into a more ade- 
quate context. On every college 
campus there are historians, sociol- 
ogists, psychologists^ and political 
scientists who could provide the 
backdrop against which the descrip- 
tive data can be viewed. Too fre- 
quently, in studies reported, such 
matters as precise historical infor- 
mation have been overlooked. Uhat 
is being called for here, of course, 
is the utilization of the full re- 
search potential of an institution 
rather than just that of an office 
of institutional research. 

Remarks thus far have implied an 

elaborate follow-up study seeking to 
determine as precisely as possible the 
true impact of college on human behav- 
ior. If this is the intent of an insti- 
tution, the effort must be made. How- 
ever, some purposes can be served by less 
intensive efforts. One institution may 
want to know in what occupations prod- 
ucts of a school of journalism are en- 
gaged. Another may wish to discover 
the number of daughters graduates have 
so that a , student recruitment campai'^n 



may be begun. Or another may simply 
wish an up-to-date registry of former 
students. Such matters do not need an 
extensive theoretical formulation nor 
do they require elaborate data collect- 
ir ^ devices nor procedures for the 
treatment of data. To accomplish such 
studies, a simple questionnaire may be 
sufficient or some adaptation of one 
or several other devices such as: 

1* Group interviews with returning 
alumni. If each year at reunion 
time one or two groups of alumni 
were invited to return a d^^v early 
to be interviewed about themselves, 
a college could gain considerable 
knowledge which could be of use. 

2* Depth interviews with graduates 
in their homes. Virtually every 
college sends representatives to 
meetings of all sorts. If every 
such representative could be asked 
to interview for at least an hour 
a former student and prepare a 
written report, within a few years 
a sizable body of knowledge about 
graduates would result. 

Telephone interviews . If there 
is a substantial number of graduates 
living in an urban area, consider- 
able information can be accumulated 
relatively inexpensively by tele- 
phone. Several housewives paid at 
a rate of twenty-five cents a call 
could obtain more precise informa- 
tion quickly than could a question- 
naire. Besides, the fact that one 
never knows about the non-respondent 
in a questionnaire study is not oper 
ative. 

4. Analysis of correspondence . 
Yearly there flows into the various 
offices correspondence from former 
students. While much of this is 
concentrated in the alumni office, 
other centers receive their share. 
The substance of most such letters 
is transitory, hence the documents 
are not needed for permanent files. 
If a procedure could be devised so 
that all such correspondence could 
be collected and quantified, another 
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way of knowing about graduates 
would be available. Intelligent 
part-time student help could be 
trained to make such content anal- 
yses; hence the cost for doing 
such studies would not be great. 
Higher education in America has 
been long on theory and speculation 
but short on empirical data concern- 
ing its operations and its accomplish- 
ments. Gradually this picture is 
changing as data are gathered routinely 
about cost per full-time student, 



space utilization, and faculty load. 

As time goes on, the significance of 
data about graduates will appear 
greater if only for the purpose of 
justifying rising collegiate expenses. 
When that time comes, yearly summaries 
about graduates will be as routine as 
yearly lists of academic aptitude test 
scores are now. Before that time ar- 
rives, considerable thought should be 
given to the issues this panel and 
group are to consider. 
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COMMENTS ON STUDENT FOLLOW-UP STUDIES 



Junius A. Davis 
Research Psychologist 
Educational Testing Service 



ALTHOUGH DR. MAYHEW has not pre- 
sented the grand design for student 
follow-up studies which frustrated re- 
searchers like me have hoped for, he, 
like Stanford University, covers a lot 
of ground and erects a great variety 
of fascinating facilities. In cooment- 
ing on such a paper, the temptation is 
to take a biased sample of the points 
made, and comment, as if sagelyy on 
each in turn. For example, I should 
dearly love to take issue with the em- 
phasis on interview data, for I do not 
know how to solve problems of bias or 
treatment of data. -But your opinions, 
as mine, are preformed, and there is 
little to be gained by side- taking 
with you and/or Mayhew. 

To dispose nicely of this tempta- 
tion, it may merely be said that some 
of the notions are ingenious, some 
creative (a dangerous term these days) , 
some courageous, and some incredible. 
Yet, running through his comments is 
one stark conviction that is all of 
these things. This is that college 
may not be the source or catalyst for 
ail personal qualities and attainments 
our culture defines as valued and that. 



A summary of comments about the Lewis B. 
A Research Design." 



if it were, assessment does not derive 
from polling the cooperative 50 per cent 
of the alumni for a few kinds of data 
easy to come by, such as marital status, 
“number of children, or job title. 

A review of the research (see, for 
example, Freedman's chapter in The A mer - 
ican College) proves quickly that Dr. 
Mayhew has risen significantly above 
the rest of us in this fascinating spec- 
ulation. It may be useful to summarize 
the sources of variation among adults 
which may plague those doing evaluation 
studies by follow-up of alumni. 

The first of these may be called the 
origin and early life factors. The vis- 
tas of opportunities open to a person 
are determined in large part, in spite 
of our Horatio Alger myth, by the socio- 
economic limits of the parents, their 
intelligence, their values. Some capa- 
cities such as general intelligence 
come primarily from the parents, and 
may be expected in and of themselves to 
affect attainment. And certainly there 
are ample data to show that the forma- 
tion of basic personality characteris- 
tics and many attitudes— from work habits 
to reaction to authority- -are developed 

Mayhew paper, "Student Follow-up Studies - 
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and stabilized before college gets a 
crack at a portion of the population 
it considers conge '1 to its peculiar 
vested interests. gh the Bennington 

studies have sbnvf; ... ^>xample, in- 
creasing liberf il. In politica.l prefer- 
ence emerging ovc: college years, 

one may well wonder rf this liberalism 
extends to child rearing practices or 
the ritual of being presented to so- 
ciety. Only when an i.nstitution has 
an undeniable, forceful, and pervasive 
commitment in its faculty and program 
would it seem reasonable to attempt to 
attribute such adult personal adjust- 
ment patterns to college experiences. 

A second category may be entitled 
the Era or natuie-of-the-times factor. 
Young people growing up or graduating 
in depression or war times have observ- 
able, predictable attitudes and mores; 
one learns this through broad social- 
cultural historical analyses. Here 
again the point is to expect that some 
characteristic adult patterns are more 
influenced by ubiquitous television or 
ease of travel than by four years at 
Sivash. Mayhew*s argument for utiliz- 
ing specialists from the faculty in 
follow-up studies has real meaning 
here: the sociologist, the ecologist, 

the political scientist, tr.e historian 
have a contribution separating era 
impact from collr*. ;ipact. 

A third kind of force that needs 
identification consists of those bene- 
fits that may accrue purely from the 
status of ^ college degree . Special 
and ingenious study needs to be con- 
ducted to determine what values derive 
from the baccalaureate stamp of ap- 
proval. Even speculative analysis of 
follow-up s tv lies in this regard — or 
their planning with this in mind — 
should pay off. 

Fourth, and crucial for our pur- 
poses, are those changes that the col - 
lege experience itself can and should 
be expected to induce. To contrive a 
reasonable set of criteria is an exer- 
cise in self-control and restraint, 
ability to recognize one's personal 



biases, and capacity to accept reality. 
We can start with subject matter — those 
enduring aspects of knowledge and skills 
we deal with openly, dqyotedly. and con- 
tinuously. This is not necessarily say- 
ing that end-of-term tests, senior com- 
prehensives, or standardized achievement 
tests should be administered at the five 
year reunion, although if we really get 
dowTi to courageous simplicity we may try 
this. I've wondered, however, what we 
might find if we commissioned our fac- 
ulty to write questions drawn from their 
course units but to be administered five 
years after graduation. What should 
those in Philosophy 207 or Political 
Science 101 do at age 25 or 30 which 
may distinguish them from persons who 
did not have that experience? 

Thus far in this conference we have 
demonstrated that we tend to view the 
faculty as incompetent, individualistic 
or eccentric, impractical trouble-makers 
who at worst must be patiently contained 
or at best can be safely ignored now be- 
cause we are on the side of and part of 
the administration. Such a view is not 
only unfittingly pompous at our present 
meager state of professional competency, 
but also suicidal if we are to under- 
stand and fciClixtate the improvement of 
the educational experience. Some of our 
faculty may have ideas worth noting if 
we can give them something in which to 
sink their hearts rather than their 
teeth. 

Although comments about origin, era, 
and status factors against the plea for 
assessment of grovth related to the aca- 
demic experience might imply blindness 
to other more general college-derived 
competencies, there is a case for the 
expectation that a person with four 
years of study^ reading, and getting 
excited about issues, may approach life 
with a higher order of reasoning than 
can be demonstrated in the context of a 
course or discipline. Here goals need 
to be spelled out carefully; Mayhew has 
suggested several good ones, such as 
"tolerance for ambiguity," or "openness 
to experience." The trick now ;..s to 
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find some way to test such qualities, 
to relate them to college experience 
more specifically than to other sources 
which might nourish them as well, and 
ultimately to find some convincing 
argument for their value rather than 
to assume, childlike, their goodness: 
tolerance for ambiguity could have 
catastrophic effects, for example, on 
performance in some adult work roles. 

Finally, the chance or contingency 
factors are always with us. My most 
illustrious classmate heads a multi- 
million dollar pharmaceutical house 
because cf the untimely death of a 
mad uncle who took the immediate heirs 
with him; the classmate I had sus- 
pected would snare early prominence 
in American Men of Science was struck 
down by a hustling cab driver in 
Washington Square. Less dramatic 
events, such as the choice of job 
offer X over job offer Y, can also 
cause qualitative variation in grad- 
uates. 

There may be other major sources 
of variation in criteria which we may 
generate to express important dif- 
ferences among adults (for example, 
physical health or choice of mate). 

The significant point that Mayhew has 
made is that we have generally accepted 
college as God, failing to render unto 
Caesar that which is Caesar's, parti- 
cularly when we value Caesar's contri- 
bution. College may have little real 
impact other than providing, for some, 
a pre-apprenticeship training, but 
avoiding the real issues and focusing 
•pristinely on cutccmes we should like 
to take credit for or on simple, ac- 
cessible facts we can count, is dis- 
honCiSt, time consuming, delusive, and 
sterile. 

A second general area for summary 
comment is that of technical design of 
follow-up studies. After the formula- 
t'xon of theory, the redefinition of 
college goals, and the creation of 
criteria to reflect these, and before 
testing our alumni, we must test our 
entering freshmen. Growth involves 



change; evaluation generally must be 
based cn before vs. after measures. 

It is remarkable that we always assess 
at the end and seldom at the beginning 
of a course or a curriculum. Mayhew 's 
appeal for measuring with the same 
stick but at different stages cannot 
be over-emphasized. 

Another necessity of design, and 
one harder to come by, is what Mayhew 
has called the control group. Some 
years ago every college that contrived 
a rapid reading program noted phenomenal 
gains, no matter what techniques were 
used. Most of these pioneer hopes 
washed out when those students who had 
not taken the special v^ork were tested 
as well as those who had. Certainly 
many of the changes we should hope to 
find induced by college may result from 
extra-college experiences; maturation 
is not the priority of the college- 
going. Many of the things believed to 
be created by college experience may be 
already there or germinating. Those 
lasting and enduring competencies and 
attitudes cited in the usual statements 
of objectives are also nourished by 
other parts of society; the church, 
work, the press, the experience of 
parenthood, the rewards and punishments 
of life all have instructive value. 

Obtaining a control group is dif- 
ficult. One must approach, at the on- 
set, individuals for whom the college 
has no responsibility and little rap- 
port. The fact that their make-up and 
decisions are not such that they are 
part of the student body may make it 
Impossible to establish a group similar 
in every important respect except for 
sustaining the college experience. 

Those who choose a particular college 
are probably different from those who 
choose another; those who seek college 
have different needs, values, and be- 
havioral patterns from those who do not, 
and these very characteristics may pro- 
duce some of the later accomplishment 
for which we ourselves should like to 
take credit. Nevertheless, the advan- 
tages of partial solution outweigh the 
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limitation when no snch comparisons 
are possible. 

The strength felt from the numbers 
attending this conference and the other 
signs of creeping professionalism that 
will be evident at our business ses- 
sion can be justified if planning as 
well as data are shared. In follow-up 
studies, it is frequently instructive 
to compare our product with those of 
other institutions which may be lik- 
ened to or contrasted with ours; com- 
parisons can be sharpened if we can 
begin to share some elements of good 
design and some measuring instruments, 
as well as companionship. For a long 
time, colleges have not had the courage 
to explore such questions except where 
prior experience indicates they will 
not suffer in the comparison, but we 
have shown some signs of growing up. 

Finally, it may pay rich dividends 
if in follow-up studies we consider 
intra- institutional differences. The 
college experience is different for 
young people vs. adults, for full-time 
vs. part-time students, for students 
sitting at the feet of professor X vs. 
those sleeping through professor Y's 
lectures. The fact that these dif- 
ferences may be more readily manipu- 
lated (we can try a new program or 
approach, then test again) means that 
we may find opportunities for fruit- 
ful experimentation. 

Thus, our problem is not so simple 
as administering some little jim-dandy 
achievement tests after a period of 
time (although tests such as those 
available in the National Guidance 
Testing Program are constructed for 
this purpose, and have real value). 

A number of researchers at ETS and 
elsewhere are struggling with formula- 



tion of goals appropriate to colleges 
in general, and are attempting to find 
more sophisticated ways to measure 
value development and attitudinal 
change, or to establish useful and 
sophisticated criteria of success in 
life and in work which may be reason- 
ably related to educational experience. 
The biographical inventory Dr. Mayhew 
has cited is well into pretesting 
stages, and ’’normative" data for a 
range of colleges and at freshman or 
senior levels will shortly be avail- 
able. But the value of good follow-up 
data, the uniqueness of each institu- 
tion, and the time and many elements 
involved, indicate it is not too early 
to start work. 

I take it that some persons are not 
at all convinced we are ready to do any- 
thing but to choose among returning to 
teaching, sneaking into administration, 
or holding pat as long as the present 
administration is in power and enjoying 
the vistas from our windows as our 
clerks take over our work. They are, 
of course, eminently correct; I can 
cite no data in disproof. However, the 
search can be fun, and can challenge 
the best in us for the rest of our 
lives. I believe that, as a profession 
and as individuals in that profession, 
long-term survival is not a function of 
the volume of necessary but temporal 
housekeeping research done, but of the 
degree of success in identifying and 
evaluating the changes that college 
induces In students. What colleges do 
to students is the most basic question 
facing us; an effective solution pro- 
vides criteria against which all other 
facts and factors we deal with can be 
examined . 
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BUDGETARY IMPLICATIONS OF FACULTY LOAD STUDIES 



D. Gordon Tyndall 
Director of Analytical Studies 
University California 



FACULTY LOAD studies have many and 
varied budgetary implications, in ad- 
dition to many other uses in the admin 
istration of a college or university, 
but I have no intention of attempting 
a systematic description and analysis 
of all the budgetary implications of 
faculty load studies. The focuT of 
our conference this year is on future 
planning (by which I think we meant 
planning for the future, not planning 
in the future) and I plan to restrict 
myself narrowly to one particular use 
to which faculty load studies can be 
put in this area of planning for the 
future. 

Having narrowed my subject in a 
way which is probably not consistent 
with the Planning Committee's goal in 
assigning me this topic, I now want 
to broaden the definition of faculty 
load studies to include not only the 
traditional study of the apportionment 
of the faculty members' time among 
teaching, research, administration, 
public service, etc., based on forms 
filled out by the individual faculty 
member and/or his departmental chair- 
man or dean (we at California also 
indulge in this type of study to the 
annoyance of our faculty and the 
frustration of my staff), but also to 
include studies based on the instruc- 
tion actually given by the faculty 
and other members of the teaching 



staff as reported in records collected 
by the registrars. We are now combin- 
ing the results of these two types of 
faculty load studies in ways which seem 
to be providing solutions or at least 
to be pointing the way toward solutions 
of some of our knottiest problems in 
the area of budgetary planning. 

Some of you may not be faced with 
these problems, in which case you will 
have only an academic interest in my 
remarks today, because I plan to con- 
fine myself to a statement of one prob- 
lem at our "Multiversity" and a des- 
cription of our attempt to solve it 
based on faculty load studies in the 
two senses described above. 

The Problem 

The probleiii is in one sense a very 
simple one. It is to find the optimal 
allocation of the limited resources 
which the University can expect the 
State to make available to it in the 
next two decades, to educate those 
among the top 12-1/2 per cent of Cali- 
fornia's high school graduates who 
choose to come to us, to provide pro- 
fessional and graduate instruction es- 
pecially at the doctoral level to the 
accelerating number of Californians and 
qualified students from other states 
and nations who will seek more special- 
ized or advanced training, to continue 



142 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



to push outward the frontiers of learn- 
ing, to assist agriculture and industry 
in achieving greater efficiency, and to 
provide opportunities for adult educa- 
tion, both intellectual and cultural. 

To meet this challenge, the University 
has planned to continue and accelerate 
the shift in emphasis at Berkeley and 
Los Angeles from undergraduate to grad- 
uate instruction; to develop the Davis, 
Riverside, and Santa Barbara campuses 
into well-rounded institutions of 
limited size with professional schools 
and graduate programs offering the 
doctorate in most areas of study; and 
to develop three new campuses at Santa 
Cruz, Irvine, and San Diego, each de- 
signed for ultimate capacity of 27,500 
students, each with a broad range of 
instructional programs at all levels, 
but each having a distinctive approach 
to the common goal of achieving ex- 
cellence in education. 

We in the statewide administra- 
tion of the University have the task 
of finding a method of allocating the 
funds made available to us by the 
State among the nine campuses, which 
are experiencing growth at quite dif- 
ferent rates and of quite different 
types. Those of you who are especial- 
ly good at mental arithmetic may have 
noted slyly that I only named eight 
campuses whereas now I speak of nine. 
The ninth is our San Francisco Medical 
Center, which leads me to inLerject 
that in addition to San Francisco and 
the heavily research-oriented medical 
t enter at Los Angeles, we are now 
planning medical centers at San Diego 
and Davis. We know full well that if 
we added together the well-documented 
and fully justified needs which each 
campus could present to us, the total 
would far exceed the funds which are 
going to be available. To anyone 
trained in economics, the problem 
seems to cry for a pricing solution, 
but for obvious reasons such a solu- 
tion is not available. If then we 
must ration resources in a way which 
will meet the needs of each campus to 



the greatest extent possible within 
the bounds placed by the available re- 
sources, but without giving any campus 
any undue advantage or placing any one 
campus at a particular disadvantage, 
it is essential to have some objective 
measure of need. It has seemed to us 
that one measure, perhaps the only 
practical and reasonable measure of 
need, is cost; not, of course, actual 
cost or projected cost based on pro- 
gram plans designed to provide the best 
in education regardless of cost, but 
some normative or standard cost which 
reflects the impact of those under- 
lying variables which are at work in 
this industry which we call higher 
education. 

What then are these variables? 

Each of us would probably come up with 
a different list, but I will suggest 
four: (1) the total nimiber of students 

on the campus, (2) the mix of the stu- 
dents by level of instruction, (3) the 
mix of the students by program, and 
(4) the quality and/or method of in- 
struction. 

My colleagues on the faculty at 
Berkeley insist that the University is 
not a factory, that we do not simply 
produce graduates or Student Credit 
Hours, and I agree fully and whole- 
heartedly. Nevertheless, I think it 
may be useful for our present purposes 
to draw a parallel with industrial op- 
erations. The number of students is a 
measure of the volume of operations, 
and we know that costs usually vary 
significantly with the level of output. 
Students at various levels of instruc- 
tion can be likened to a product going 
through various stages of production. 
Some of you may argue that education 
is or at least should be a continuous 
process with no essential change as 
one moves from the freshman to post- 
doctoral student, that there is no 
reason to postulate or perhaps one 
should say to admit or permit any 
change in costs at the various levels, 
but we do not accept this view. It is 
not that we believe that the education 
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of the freshman is any less important 
or in one sense is any less difficult 
than that of the upper division stu- 
dent or the candidate for thz master's 
degree or the Ph«D, or the post- 
doctoral student^ but rather that to 
achieve a comparable quality of educa- 
tional experience requires more fac- 
ulty time per student^ more expensive 
faculty, and frequently more expensive 
library, laboratory, and research fa- 
cilities the higher the level of in- 
struction. 

Students in different programs are 
simply different products; in some sit- 
uations we have some difficult problems 
of joint cost allocation and we have to 
solve them as arbitrarily as industry 
does. Certainly there is no more rea- 
son to expect the cost of engineering 
education per student to be the same 
as the cost of medical education per 
student, than to expect the cost of a 
stethoscope to be the same as that of 
a theodolite. Finally we know that 
high quality production usually in- 
volves increased cost whatever the 
product, and that differences in pro- 
ductive methods can result in wide 
differences in costs of production. 

Let me first dispose of the last 
categorjr: differences in the quality 

and/or methods of instruction. This 
involves not a single variable but 
rather two closely related variables. 
Our philoaophy is th.it it is the duty 
and privilege and responsibility of 
each campus to devise methods of in- 
struction which will be optimal in 
terms of quality of instruction for 
its particular situation in terms of 
total numbers of students and of its 
student mix by level and program, but 
subject to the general constraint that, 
for its particular number and mix, its 
total costs should be no higher than 
the standard or norm for that number 
and mix. 

This obviously implies that there 
is such a standard and I shall now try 
to explain briefly how we are develop- 
ing such a standard. 



Development of Standard 

Our problem has been to try to un- 
ravel the relationship of cost to vol- 
ume of instruction, level of instruc- 
tion, and instructional program or dis- 
cipline from a limited body of cost 
data which reflects the combined ef- 
fects of these three variables plus 
independent differences in methods of 
instruction and possibly of quality of 
instruction. Frankly, the data is 
grossly inadequate to the task, but we 
have done the best we could with it. 

We are rapidly accumulating more data 
and we hope to make it more accurate 
and more refined as time goes on. 

To date we have concentrated pri- 
marily on the first two variables and 
hav^e dealt somewhat summarily with the 
problem of differences in program. We 
have felt justified in this because, 
except for the San Francisco Campus, 
each campus is to provide instruction 
in all the standard disciplines and 
will provide professional and advanced 
training in several areas. Thus it has 
seemed reasonable, at least initially, 
to establish norms for "general campus" 
operation excluding the medical centers 
at San Francisco and Los Angeles and 
Veterinary Medicine at Davis, while 
recognizing the need for permitting ex- 
ceptions on an ^ hoc basis if circum- 
stances require a campus to have a 
relatively large program in a rela- 
tively high cost area at an early stags 
in its development. We may ultimately 
find it desirable to establish norms 
for each discipline or even each depart- 
ment, but there aie a number of cogent 
reasons for avoid.\ng too much refine- 
ment of this kind. 

Our treatment of the effect of 
costs of differing levels of instruc- 
tion is fairly orthodox. We ha’^'e at- 
tempted to measure the relative cost 
per Student Credit Hour (SCH) and/or 
per student at six different instruc- 
tional levels: lower division, upper 

division, graduate professional, mas- 
ter's degree, first stage doctoral. 
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and second stage or advanced doctoral. 

The components of instructional 
time more readily accepted and identi- 
fied with instructional costs are or- 
ganized class time, tutorial instruc- 
tion and non-course instruction (i.e., 
the faculty time spent in guidance of 
student research), oral and qualifying 
examinations, etc. Expenditures for 
faculty departmental research time, 
however, present an entirely differeiit 
set of cmsiderations. It has been 
argued that research time is a distinct 
and independent responsibility of a 
university and as such should be sup- 
ported budgetarily on its own merits 
and should not enter into the computa- 
tion of instructional costs. Yet, one 
of the significant distinguishing char- 
acteristics of the leading universities 
is that every faculty member expects 
and is expected to engage in research 
in addition to his regular teaching 
duties. Then again there is the fa- 
miliar and very cogent argument for 
the inseparability of teaching at the 
graduate level and research; a univer- 
sity is, almost by definition, the 
place where teaching and research are 
joined. Effective teaching, at least 
at advanced levels, is best accom- 
plished by one who is himself actively 
engaged in the pursuit of knowledge; 
teaching and research contribute to 
each other in many ways. 

Design of Study 

The subtle but very real distinc- 
tions embodied in these positions sug- 
gest three alternative means of inter- 
preting faculty research time in rela- 
tion to instructional costs; (1) ex- 
clude all of faculty research time 
from consideration in determining in- 
structional costs, (2) assign to in- 
structional costs only that portion of 
research time which is directly appli- 
cable to teaching, and (3) allocate 
all faculty research time to instruc- 
tional costs. The latter two alterna- 
tives immediately give rise to an ad- 



ditional consideration; should these 
costs be allocated to all students, to 
upper and graduate division students 
only, to all graduate students only, 
or only to the most advanced graduate 
students. 

Practical problems related to our 
continuing struggle for adequate budg- 
etary support from the State Legisla- 
ture have led us to develop an approach 
which combines alternatives two and 
three; we first segregate departmental 
, research into two categories based on 
our periodic faculty load studies — 
’’research teaching” and ’’other depart- 
mental research.” We allocate "re- 
search teaching” costs to all levels 
of instruction in proportion to the 
time which the faculty actually spends 
in teaching at the various levels, but 
assign "other departmental research" 
costs exclusively to the advanced doc- 
toral instruction. The significance of 
this approach is twofold; (1) it "pro- 
vides" research time to the faculty of 
professional schools and the so-called 
emerging campuses which may have few 
or no advanced doctoral students, and 
(2) it assigns the major part of re- 
search costs to the advanced doctoral 
students. In practice, this presently 
results in the allocation of approxi- 
mately 40 per cent of total departmental 
research costs among all levels of in- 
struction and 60 per cent to advanced 
doctoral work alone. 

Finally we turn to the impact of 
volume of output on costs. Here we 
have attempted to develop production 
functions for lower, upper, and grad- 
uate level instruction, using the Stu- 
dent Credit Hour as- our measure of 
output and faculty teaching time as 
shown in the class schedule data as 
the measure of input. Using both his- 
torical and cross-sectional analyses 
of these data, we have developed what 
we call indices of productivity or 
maturity which relate Student Credit 
Hours per Full-Time Equivalent faculty-- 
which may be thought of as a measure of 
average productivity— to the number of 
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Full-Time Equivalent students at the 
particular level of instruction on a 
campus . 

We then combine the weights by 
level of instruction and the indices 
with the projected enrollments to ob- 
tain a measure of the relative need of 
each campus for faculty and related 
financial support. The number of stu- 
dents at each level is divided by the 
index for that number at that level: 
these quotients are then multiplied by 
the appropriate weight and the result- 
ing products can then be sunmed to ob- 
tain the modified or indexed number of 
weighted FTE or lower division equiva- 
lent students. In order to determine 
how many faculty this campus should ac- 



tually be budgeted for, it is necessary 
to obtain a uniform weighted student- 
faculty or student-staff ratio by sum- 
ming the modified students projected 
for all campuses and dividing the sum 
by the total number of faculty that the 
State is expected to be willing to fi- 
nance. The number of modified weighted 
students on the one campus would then 
be divided by this ratio to determine 
its share of the total faculty. 

This approach to the solution of 
our problem has received approval in 
principle by the University adminis- 
tration. Our next tasks are to sell 
it to the Senate committees and to the 
State. We have some interesting days 
ahead. 
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PROBLEMS IN INTER - INSTITUTION AL COOPERATION 
IN RESEARCH 



THE ATTENDANCE and the interest in 
this Third Annual National Institutional 
Research Forum is evidence of the ac- 
ceptance by higher education administra- 
tors and governing boards of the role 
to be played by the institutional re- 
search office. The institutional re- 
search office obtains objective evidence 
of the status of the institution--or in- 
stitutions — and, through analyses and 
interpretations, develops guidelines 
for solving problems as well as for 
orderly long-term growth. Whether the 
research is inter - or Jjn^ra- institu- 
tional, personnel must be provided who 
can do the job. Institutional research 
offices have been created in ever- 
increasing numbers during the past 10 
years to do the research tasks that 
formerly had bean neglected or had been 
inadequately performed. 

A basic difference between intra- 
institutional (involving one institu- 
tion) and inter-institutional research 
(involving two or more institutions) 
is that the intra-institutional study 
tends to be detailed and pointed to 
given colleges, departments, or other 
units, while the inter- institutional 
study tends to be more general in scope 
and treatment. 

For purposes of this presentation, 

I will limit the definition of "re- 
search” to the systematic investiga- 
tion of existing operational similar- 
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ities or differences betwe m two or 
more institutions, having as its ob- 
jective the resolution of common prob- 
lems or the formulation of hypotheses 
to study problems still unresolved. 

W. H. Cowley^ has described educa- 
tional research as "any thorough-going 
investigation of an educational prob- 
lem; and institutional research in 
higher education constitutes such an 
investigation of any topic concerning 
which a college or university or a 
group of them collects or seeks to col- 
lect data toward the end of improving 
operations. " 

John Dale Russell^ has identified 
such research as applied rather than, 
basic and stated that most commonly 
such research consists of studies of 
status; descriptions of current prac- 
tices and conditions; studies of trends, 
particularly historical sequences; and 
evaluative studies which compare the 
outcome of different policies and pro- 
cedures . 

Our consideration, then, is of a 
type of inspection and analysis that is 
directed toward some immediately prac- 
tical application. 

While institutions in the past have 
been better known by their reluctance 
to divulge their operations to an in- 
spection that would permit comparisons 
with another institution, they are now 
finding that the advantages to be gain<i«i 



148 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



by such comparisons, and the accompany- 
ing communication and exchange of ideas, 
benefit them more than harm them. Con- 
tinued rapid increases in enrollments, 
limitations of financial resources, 
shortages of properly trained faculty 
and other personnel, and demands on 
physical facilities are some of the 
problems common to all institutions 
that must be examined carefully for 
possible solutions. 

Objectives of Inter- institutional 
Studies 

Inter- institutional research may 
be justified for one or for many rea- 
sons, These reasons may vary accord- 
ing to the purposes of different in- 
stitutions as well as according to the 
unsolved problems of the institutions. 

At any rate, a basic purpose is to help 
the institutions to establish control 
over the future by establishing objec- 
tive guidelines to be followed, 

A list of reasons for doing inter- 
institutional research is likely to in- 
clude the following, in whole or in 
part, but not necessarily in the order 
listed: 

1, To provide the design for in- 
telligent planning for the 

future: 

a. To collect status informa- 
tion for making decisions. 

b. To identify needs. 

c. To note changes from ear- 
lier studies. 

2. To suggest ways to improve the 

efficiency of operations: 

a. To compare with peer in- 
stitutions; note similar- 
ities, differences, dif- 
ferent approaches to prob- 
lem solutions. 

b. To reduce unnecessary inter- 
institutional competition. 

c. To prevent undesirable dup- 
lication of high-cost, spe- 
cialized programs, 

d. To identify areas of pos- 
sible cooperation and sug- 



gest means of coordinating 
efforts. 

3, To improve instruction and stu- 
dent services: To insure or- 

derly development of programs, 

4, To provide objective measures 
and normative guides for budg- 
et-making. 

5, To anticipate and prevent prob- 
lems from occurring. 

Topics Most Frequently Inc luded J^n 
Inter- ins t i tut iona 1 Studies 

Studies made by the U.S. Office of 
Education^ for the periods 1951-55 and 
1956-59 provide information on the 
areas most frequently investigated in 
202 cooperative studies in an eight- 
year period. These 202 different 
studies had a combined total of 652 
topics covered. The most frequent of 
the seven major topics was enrollment, 
which was followed in turn by programs, 
financing, organization and administra- 
tion, physical facilities, junior col- 
lege development, and faculty. These 
topics were included on a frequency 
that ranged from a high of 60 per cent 
for enrollment to a low of 36 per cent 
for faculty (See table on page 149). 

K inds of Problems Encountered in Inter - 
institutional Research 

This statement appeared in the in- 
troduction to the Second Look at the 
Sixty Colley.e Study : "Higher educa- 

tion is the only major financial enter- 
prise in America that is not supplied 
by a fact-finding agency, such as a 
trade association, or an industry- 
sponsored research bureau, with finan- 
cial data in such form that administra- 
tors of colleges and universities can 
readily identify variations in the op- 
erations of their own institutions 
from established norms for higher edu- 
cation as a whole. 

Educators and those who have a re- 
sponsibility for research and for ad- 
ministering institutions of higher edu- 
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DISTRIBUTION OF TOPICS IN 202 STUDIES 



Topics 


1951-55 

% 


1956-59 


Total 


Percentage of 
Studies Which 
Included Each 


Total Studies 


49 


153 


202 




Enrollment 


31 


91 


122 


60 


Programs 


25 


80 


105 


52 


Financing 


25 


75 


100 


50 


Organization and Administration 


28 


62 


90 


45 


Physical Facilities 


13 


72 


85 


42 


Junior College Development 


16 


61 


77 


33 


Faculty 


13 


60 


73 


36 



cation recognize the situation just 
mentioned as a major deterrent to 
evaluating their work, and some are 
beginning to do something about ac- 
cumulating such a body of knowledge. 
Various educational agencies compile 
data for specific purposes. However, 
whether local or national, there still 
needs to be greater attention given to 
identifying, defining, and collecting 
on a systematic and timely schedule 
the facts needed for making decisions 
and for planning. 

Experience with inter- institutional 
research projects that have been co- 
ordinated in the U.S. Office of Educa- 
tion indicates that three major prob- 
lems may be expected; these are: 

1. Inadequate institutional 
record-keeping for furnishing 
needed data. 

2. Unwise assignment of institu- 
tional personnel to the joint 
project. 

3. Lack of agreement in establish- 
ing and holding to priorities 
to assure that target dates 
can be met. 

An investigation of many inter- 
institutional research studies, pri- 
marily outside the U.S. Office of 
Education, indicates that the follow- 
ing items often become handicapping 
problems. Not all of them are common 
only to inter- institutional studies. 



Most are encountered in any resea'.^L 
effort. They may be fitted into live 
• groups : 

1. Identifying the problem 

setting up the research plan 

a. Inadequate advance planning 
to insure maximum benefits. 

b. Inadequate or unclear state 
ment of the problem or prob 
lems; failure to set spe- 
cific limits on the prob- 
lem. 

c. Lack of set of definitions 
to be used, preferably ones 
having national acceptance, 

d. Failure to agree upon def- 
inite plan for conducting 
the study, including the 
procedures and techniques 
to be used. 

2. Securin g personnel and facil - 
ities to do study 

a. Inadequate and unqualified 
personnel assigned to pro- 
ject. 

b. Insufficient budget. 

c. Inadequate space to house 
researchers and data. 

d. Inadequate travel funds. 

e. All cooperating units not 
equally sold on the impor- 
tance of the research. 

3. Collecting and processing data 

a. Data not readily available. 

b. Inadequate clerical and 
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machine service to process 
data, 

c. Inability to maintain per- 
formance schedule, 

4, Stating findings , recommenda - 
tions 

a. Failure to identify areas 
needing depth studies, 

b. Insufficient publicity to 
let others who are poten- 
tially interested parties 
know what is going on, 

c. Compromises that weaken 
recommendations , 

d. Failure to give adequate 
consideration- to differing 
points of view, 

e. Prejudices, self-interest 
showing, 

f. Failure to make recommen- 
dations that are realistic 
in achievement, 

g. Failure to provide norms 
for future comparison^, 

5, Putting recommendations into 
effect ; follow-up 

a. Lack of opportunities to 
follow up on findings, 
recommendations, 

b. Resources required to put 
recommendations into effect 
not provided, 

c. Failure to ’’sell” recommen- 
dations, 

d. Inaccurate interpretation 
of recommendations. 

Institutional Differences that Cause 
Problems in Inter- institutional 
Research 

A claimed strength of higher edu- 
cation in the United States is the in- 
dividuality of each institution. One 
institution does not want or dare to be 
too much like another. For purposes of 
inter-institutional research, this 
characteristic creates problems such 
as the following: 

1, Differences in objectives and 
purposes may force an institu- 
tion into a mold which it may 



not feel is a good fit, 

2, Differences in budget, fiscal 
year, and accounting proce- 
dures cause problems in secur- 
ing comparable financial data, 

3, Differences in size, services 
provided, and utilization of 
resources make meaningful com- 
parisons difficult. 

Things that Could be Done at the 
National Level to Improve Inter - 
institutional Research 

Even if it were practical, it is 
not desirable that higher education 
institutions be fitted into a uniform 
pattern of administration, teaching, 
and services. However, there appear 
to be many areas in which greater uni- 
formity could be accomplished to the 
mutual benefit of all. 

As one agent at the national level, 
the U,o, Office of Education has an 
assigned role in the collection, dis- 
semination, and improvement of educa- 
tion, Through its data- gathering ac- 
tivities, the Office has much influence 
on the kinds of records kept. It ap- 
pears that the time has come for a 
reassessment of the role of the Office 
in carrying out its basic function of 
service to the education community. 

It is important to recognize that 
automation is a fact of life, and our 
only concern now is not whether to use 
it but how to make the fullest use of 
it. To do this will require that plan- 
ning steps be trken to serve the insti- 
tutions and the nation more effectively. 
These steps i',i,!’ude (1) developing 
definitions and techniques for gather- 
ing and reporting data, (2) planning 
long-range programs of studies, (3) 
meeting needed deadlines for reporting 
findings, and (4) providing more spe- 
cialized services from the national 
level. 

In case the relationship of this 
needed reassessment to the improvement 
of inter-institutional research is 
questioned, it seems well to note that 
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one of the most serious barriers to 
effective inter- institutional studies 
at the present time is the lack of 
common definitions and common admin- 
istration of routine activities. It 
is conceivable that many inter- 
institutional studies would not need 
to be made if meaningful data were 
available on the national level. It 
is apparent that many overlapping and 
duplicating studies could be eliminated 
as a result of the development of def- 
initions acceptable to institutions ^ 
associations, boards of higher educa- 
tion, and national data- gathering 
agencies. With other elements of the 
program developed and initiated, a 
fact gathered and reported would have 
the same meaning in all inter- 
institutional comparisons, whether it 
pertained to enrollment, financing, 
facilities, or personnel. These im- 
provements could be accomplished, it 
seems, without interfering with the 
need for an institution to be indivi- 
dualistic. 

I will conclude with an illustra- 
tion used by my colleague in the U.S. 
Office of Education, Dr. Harold A. 
Foecke, Specialist for Engineering 
Education: "To summarize my general 

feelings (regarding a data-flow sys- 
tem) I might resort to an analogy with 
another kind of system — the electrical 
power system of this nation. Before 
all of the separate power companies 
could be interconnected into a national 
system, before the characteristics of 
the suppliers of power and the needs 
of the consumers of power could be 
reconciled, agreement was necessary on 
a common frequency, on standard volt- 
ages, standard power ratings, etc. But 
the successful interconnection of sup- 
pliers and consumers does not solve the 
problem of determining the dynamic be- 
havior of the entire sj^stem, does not 
disclose how changes ia one part of 
the system affect all other parts. 

What fluctuations in the voltage sup- 
plied to one section of a city are 
caused by turning on all of the arc 



lights in the adjacent stadium? If the 
generating capacity of one power plant 
is lopt (e.g., due to flood), can other 
remote power plants handle the tempo- 
rary overload? Getting t-^’erybody 
properly 'hooked up' into the same sys- 
tem is one thing, understanding the 
characteristics of the entire system 
well enough to anticipate (and perhaps 
compensate for) the response to various 
kinds of 'disturbances' is another mat- 
ter. So too with our educational sys- 
tem — we must work imagine tely and 
tirelessly to get our educational in- 
stitutions coupled into an adequate 
and acceptable system, but we must 
simultaneously explore the emerging 
characteristics of our educational 
system."^ 

The possibilities for improvements 
in research, data-gathering, and re- 
porting in the field of higher educa- 
tion are challenging. We must deter- 
mine what steps need to be taken to 
make the improvements, such as a stand- 
ard terminology and uniform accounting 
procedure, and then put the improve- 
ments into practice. Inter- institutional 
studies would benefit, as would educa- 
tion groups at all levels. In a period 
when we are called upon to produce both 
quality and quantity, and when we are 
eager for action in our fast-changing 
world, it behooves us to move with full 
speed ahead in areas that will assist 
in accomplishing our purposes. 
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ASSESSING THE EFFECTS ON LEARNING 
OF THE NEWER MEDIA 



THE GENERAL THEME of this confer- 
ence is "The Role of Institutional Re- 
search in Planning." It is appropri- 
ate, therefore, for this seminar to 
develop its special subject within 
this general theme. 

This paper will deal with the prob- 
lems of "Assessing the Effects on 
Learning of the Newer Media," with em- 
phasis on the use of the results of 
such assessments for planning purposes. 
However, since administrative initia- 
tive and leadership always involve plan- 
ning, the subject should have values for 
a broad range of educational administra- 
tive functions. 

In order to work in this frame of 
reference, this paper and perhaps the 
following discussions, will follow a 
different pattern than would be fol- 
lowed if the discussions were intended 
for learning theorists, analytical re- 
searchers, experimental design special- 
ists, and mathematical statisticians. 
Elements from these areas of interest, 
however, will necessarily be included. 

In brief, we shall attempt to contrib- 
ute to the development of the general 
theme of the conference and at the 
same time deal constructively and imag- 
inatively with the special subject as- 
signed to us. 

The assigned topic needs some elab- 
oration and definition in order to 
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limit and focus our discussions. It is 
suggested that assessment be broadly 
conceived to include, not only the 
measurements of the effects on learning, 
but also the problems and evidence rel- 
ative to introducing the newer media 
into colleges and universities and using 
them as r^igular parts of academic pro- 
grams . 

This panel may wish to agree to de- 
fine learning effects as induced changes 
in behavior of many kinds and levels 
which occur in the direction of academic 
learning goals and defined performance 
criteria. It may be agreed, also, that 
we are discussing a broad spectrum of 
levels of learning, although there 
should be some debate on the relative 
appropriateness and efficacy of the 
newer media for regulating very ad- 
vanced and complex human learning. 

The implication in the statement of 
the subject under discussion, that the 
newer media have an effect on learning, 
needs careful discussion and clarifica- 
tion. Terminology hich imputes learn - 
ing effects to media, ^ media , although 
the terminology is widely used, is the 
basis for both misconceptions about the 
roles of media in education and mis- 
interpretations of research results on 
the "newer" media. Attention needs to 
be focused, rather, on the instructional 
and communication processes which operate 
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through the media, and especially as 
these processes interact or transact 
with students. There are probably some 
effects which are correlated with the 
specific phenotypical characteristics 
of some kinds of media, but these ef- 
fects probably constitute a very small 
part of the total configuration of the 
many variables and determinants which 
instigate meaningful human learning. 
Most probably the modes in which stim- 
ulus materials are cast, e.g., print, 
sound, pictorial and graphic modes, 
and the formats used greatly outweigh 
the effects of the special character- 
istics of particular media. For ex- 
ample, in terms of the impact on learn- 
ing, and waiving the considerations of 
practical management and apparatus, it 
seems of little consequence whether a 
particular unit of instruction is 
mediated through sound motion pictures, 
video recording, or television. The 
central consideration would seem to be 
what modes of communication, medium or 
media combinations, old or newer, can 
be used most effectively to meet the 
requirements and conditions for the 
desired kinds of learning. 

Assessment of Learning as ^ Primary 
Task of Institutional Research 

It is proposed, as a basic propo- 
sition, that all educational institu- 
tional operations should be conducted 
with the clear and expressed purposes 
of providing resources for extending 
and increasing the quality of academic 
learning. About each operation, there- 
fore, whether it be planning buildings 
and facilities, studies of student 
characteristics, or the governance of 
faculty composition and efforts, the 
primary question should be: How do 

these operations affect learning so 
defined as to include the personal, 
intellectual, and professional develop- 
ment of students? Another way to ask 
this important question is: What are 

the contingencies of each institutional 
operation to the students' academic 



achievements? 

A positive and very general state- 
ment of the task is this: How can an 

institution provide learning environ- 
ments, an ecology for learning activi- 
ties, or the conditions for learning 
which maximize the possibilities that 
the main academic purposes of an insti- 
tution may be accomplished most effec- 
tively and efficiently? 

To answer the j^tated questions or 
to attack and accomplish this task re- 
quires many kinds of assessments, judg- 
ments, decisions, aj7d evaluations. In- 
stitutional research has a special re- 
sponsibility for collecting dependable 
evidence which can serve as the basis 
for such evaluative and judgmental be- 
havior. Ideally, also, institutional 
research people should participate in 
the administrative processes which 
interpret the evidence after they have 
collected it, and aid in applying the 
conclusions to practical problems. 

The Problem of Assessment in the 
Selection of Media 

The media which are available, or 
can be designed and produced, should 
be assessed as components of integral 
systems of educational technology which 
have close contingencies to instruction 
and learning. Provisions for and use 
of the media can be thought of as at- 
tempts to provide instrumentation for 
instruction and learning, and especially 
as attempts to provide optimum condi- 
tions foi learning. Therefore, in any 
medium, or media combinations, the 
modes of communication used for organ- 
izing and presenting stimulus materials, 
and for providing for reactions and re- 
inforcement, must be assessed for their 
adequacy in terms of the possible ef- 
fects on desired kinds of learning. 

What are the media and modes of 
communication that we are considering? 
Generally, we are discussing a very 
wide range of kinds of equipment which 
has been designed and built for the en- 
coding, organizing, storage, retrieval. 
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distribution and display of informa- 
tion, content, or stimulus materials 
for learning. More recently other 
functions, considered necessary for 
learning, have been added. Provisions 
are being made in some new equipment 
designs for specified or selective re- 
actions of learners, and for the rein- 
forcement and reward of learnin^ ef- 
forts. Another way to describ^i the 
media and media systems that we are 
discussing is to say that we are as- 
sessing the possible technology which 
should help solve the logistical, 
strategic, and tactical problems of 
the management of academic learning. 

We are discussing a wide range of 
facilities for handling audio and video 
channels of communication which supple- 
ment, extend, and evvcn replace normal 
person-to-person instructional behavior. 
Examples are sound amplification sys- 
tems, audio and video recordings, pro- 
ject ional and enlargement equipment of 
many kinds; also, distribution, repro- 
duction, and display systems like wired 
sound, radio, sound motion pictures, and 
television. We might include tele- 
prompters, telephones, simulation de- 
vices, and print procedures and repro- 
ducers, as well as programmed books, 
teaching machines, and special purpose 
computers used for regulating and im- 
plementing the requirements of learn- 
ing, Finally, as examples, a compre- 
hensive discussion of the "newer" media 
cannot omit language or learning lab- 
oratories, new types of semi-automated 
instructional auditoria and new devel- 
opments of micro-miniaturized labora- 
tory apparatus, perceptual-motor skills 
trainers, provisions for extending 
human sensory capabilities, and many 
kinds of arrangements for provoking 
persistent learning responses and their 
reinforcement. 

Thus, it can be seen that due to 
the great variety of kinds of newer 
media and the complexities of their 
operations and applications, the as- 
sessments of their specific effects 
on learning is a formidable task. 



Therefore, we are compelled in this 
seminar to deal with the assessment 
problems on a level of considerable 
generality. 

Question s which Assessments May Help 
to Answer 

When assessments of the newer media 
are made to collect evidence that will 
be useful for planning and administra- 
tive decisions, a wide range of kinds 
of assessments is needed. Assuming 
that the purpose is to extend and im- 
prove learning, and that evidence will 
be accepted and used in making deci- 
sions about the newer media, then the 
work of institutional research men 
should be directed toward answering, 
among others, the following kinds of 
questions; 

1. What are the functional speci- 
fications or requirements, relative 
to instruction, stimulus materials, 
mediation, and learning, which need 
to be implemented? 

2. Do media or media combinations 
and assemblies, which appropriately 
and reliably serve the specified 
functions, exist and can they be 
purchased? 

3. Is there the need to design 
and construct new equipment compo- 
nents or systems which will meet 
the special requirements for medi- 
ating and instigating learning? 

4. Provided the necessary media 
capabilities are available, can 
the content, programs, or stimulus 
materials that are appropriate to 
the learning tasks be produced in 
suitable forms for them, in ade- 
quate quantities, and of high qual- 
ity and effectiveness? 

5. Can the instrumentation, using 
appropriate instructional materials 
and supporting resources, be oper- 
ated successfully in a normal or 
existing academic context? 

6. Will the operation of the whole 
integrated instructional system 
meet practical standards of feasi- 
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blllty , reltabtltty . economy . and 
the ’'man-machine” interdependencies? 

7. Can the medium or media com- 
binations be used extensively 
enough for the right purposes and 
academic areas to justify the in- 
vestments of funds and effort? 

8. Relative to other options of 
resources and strategies for pro- 
viding the means for satisfying 
the requirements of academic learn- 
ing, do the "newer” media have 
practical advantages or limita- 
tions, which must be known both in 
kinds and degree and which should 
affect administrative decisions on 
their uses in educational institu- 
tions? 

9. What is the evidence from con- 
trolled comparative and analytical 
studies about the effects of the 
media, the content and use pat- 
terns, on learning in terms of the 
best possible performance criteria? 

10. And finally, what is the evi- 
dence on the extent or scope of 
uses and the patterns of uses over 
the different levels and ranges of 
institutional functions and, when 
reasonable limits are reached, 
what will be the effects on the 
organization and financing of the 
institution? 

All of these questions set the 
general tasks for institutional re- 
search on assessments of the "newer" 
media. Too often media research has 
not been comprehensive enough to pro- 
vide all of the answers that are neces- 
sary for making the best administrative 
and management decisions. For example, 
research on variables operating through 
the media, on limited kinds of learning 
tasks, do not provide all of the evi- 
dence needed for deciding what media 
should be built into plans for an in- 
stitution, or what media and support 
resources should be provided for dif- 
ferent curricula and for different 
faculty members and students. Controlled 
analytical research on the effects of 
stimulus materials mediation by means 



of television, although important even 
if findings fall short of statistical 
significance, cannot provide all of 
the evidence needed to decide whether 
or not, how, and to what extent in- 
structional television should be em- 
ployed in an institution. The evi- 
dence, which answers satisfactorily 
the ten questions stated previously, 
should constitute an adequate basis 
for resolving the principal rational 
issues involved in the uses of media 
in higher education. Of course, how- 
ever, there are irrational issues and 
hundreds of other more specific and ad 
hoc questions. 

Consideration s Relative to Methods of 
Assessing the Effects on Learning of 
the Newer Mec ia 

Full-range assessment of media ef- 
fects on leairning involves a variety 
of approaches, strategies, and experi- 
mental designs. 

Reviews of the research on the 
newer media and their applications re- 
veal weaknesses in the conceptual and 
theoretical basis about what the media 
are, and the kinds of influences on 
learning which are mediated by them. 
There is a widely prevailing mystique 
which ascribes power and characteris- 
tics to the media, ^ media , which 
they do not and cannot have. The basic 
fallacy is the ascription of effects to 
the media which are in reality proper- 
ties of the stimulus content, its or- 
ganization, and the modes or formats 
by which the information is represented. 
A second conceptual fallacy is an under- 
estimation of the amount, strength, 
quality, and duration or repetition 
that is required of stimulus materials, 
a?srsuming the best transactions with the 
subjects, for significant new learning 
behavior to occur. 

A third fallacy is the concept and 
expectation that the selection and mani- 
pulation of single vaiiatles of a multi- 
variant field of perhaps a hundred 
equally potent variables will produce 
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significant differences in complex 
human learning. A fourth related mis- 
conception is the assumption that the 
ranges of variables, which act as deter- 
minants of learning, fall within the 
limits of control of media processes 
and influences. In particular, impor- 
tant characteristics of learners like 
learning "sets" and expectations, in- 
terests and motivational patterns, 
learning abilities, and perceptual 
skills have not been brought under con- 
trol of the media. A fifth and final 
conceptual fallacy that might be dis- 
cussed by the panel is what might be 
termed the input-output fallacy. This 
conception holds that stimulus presen- 
tations, as presentations, result in 
desired learning responses without 
other measures being taken to insure 
that appropriate learning responses 
occur. This view is based, also, on 
the uni-directional flow concept of 
communications, through channels, to 
the learner, and hence lead to the 
desired effects. Instructional com- 
munication is more transactional, in- 
volves many transformations, and insti- 
gates varied responses, especially in 
different individuals. The correla- 
tions between meaningful stimulus pre- 
sentations and learner responses are 
generally of a low order. 

These five fallacies can be trans- 
lated into parts of a positive concep- 
tual framework for experimental designs. 

A Perspective on the Sampling Problem 

The institutional researcher con- 
fronts a complex set of sampling prob- 
lems. Let it be assumed that samples of 
many kinds that are built into the ex- 
perimental model should provide the 
basis for reasonable generalizations of 
results and conclusions. First, there 
is the sample selection of the medium 
or media combinations to be used along 
with carriers of information and modes, 
e.g., print, graphics, pictures or 
signs, signals and symbols, or the dif- 
ferent semantic levels. Second, there 



is the component sample of content, its 
kind, academic level, and its inherent 
and modified structure. Frequently in 
media research the quantity of the in- 
structional material, and the limited 
period of time covered by its presenta- 
tion, prevent generalizations to a broad 
spectrum of academic programs. A half 
course or preferably a full course is 
perhaps necessary in order to produce 
dependable and generalizable results. 

Third, not only the amount but the 
quality of the stimulus materials is 
another desirable sampling considera- 
tion. Rarely is the quality of the 
production of experimental materials 
representative of the best possible 
quality, and levels of production qual- 
ities are rarely considered as a sam- 
pling problem. Finally, there is the 
consideration of the testing and as- 
sessment context, the normality of con- 
trols, and the descriptions of this 
context relative to the context of the 
expected applications of results. Sin- 
gle variable laboratory experiments, 
however Important for testing theoret- 
ical hypotheses, may have little con- 
gruence with academic environments 
where the results may need to be ap- 
plied. Furthermore, large universities 
are so heterogeneous from one academic 
area to another, that assessments made 
in one area may not be applied or ac- 
cepted in another area, department, or 
college. For example, few science edu- 
cators perceive any relevance to their 
instruction of language laboratory 
equipment and methods. The variations 
of learning environments of different 
institutions raise yet another question 
about the extent to which assessments 
of the effects of media on learning in 
one institution can be applied and are 
acceptable in other institutions. 

The Problem of Accumulating Additive 
Research 

All of these considerations lead 
to an Important methodological and 
practical question: How can research 





158 



NATIONAL INSTITUTIONAL RESEARCH FORUM 



and evaluations of media uses, to meet 
the conditions required for effective 
learning, be conducted, analyzed, and 
reported so that the results will add 
up or sunmate? 

One answer to this question is to 
conduct the required number of exact 
replications of important experimental 
assessment of learning where the newer 
media are used. Instances of strict 
replication, in different contexts, 
are rare indeed. There is the urge 
to do the experiments differently. 

The other answer to the question 
is to use acceptable standards for 
experimental designs, controls, meas- 
urement, statistical analyses, and 
logic of inferences. Too often in 
media research, such standards are 
not met. For example, Stickell has 
found that only ten out of over two 
hundred comparisons of direct instruc- 
tion compared with televised instruc- 
tion met reasonable criteria or stand- 
ards while about thirty other compari- 
sons could be qualifiedly accepted. 
Incidentally, all accepted comparisons 
showed "no significant statistical dif- 
ferences." Such faults were comnitted 
as using different teachers, lack of 
random assignment of subjects to com- 
parison groups, and using very limited 
amounts of instructional materials. 
Institutional researchers should place 
more emphasis than is now done on the 
problem of making assessments which 
can be summated. 

Suggestions Relative to the Measurement 
Problem 

There is one final point which 
should be made in this incomplete 
treatment of the subject of this sem- 
inar before the panelists take over 
the discussion. The general problem 
is that of having entirely adequate 
and valid measures of the different 
kinds and levels of human learning. 

In addition to well-known requirements 
for measures of learning, two possi- 



bilities seem to hold promise. First- 
for many purposes the modes of the 
measurements should be the same as 
the modes of the stimulus materials 
that were employed in the experiments. 
For example, when the stimulus mate- 
rials are in the pictorial or graphic 
modes, test items and criteria should 
also be in the pictorial or graphic 
modes. Verbal commentary stimuli 
should be tested by oral test items. 

The required and practiced learning 
responses should be measured by tests 
of the same kinds of responses. If, 
however, transfer and generalization 
are to be measured, then this should 
be defined as an additional set of 
measurement requirements. 

The second suggestion, to which the 
panel members may wish to react, is 
that efforts should be made to invent 
and develop concurrent measures of im- 
mediate learning. Examples of what is 
suggested is the technique of inserting 
criteria test items in units and se- 
quences of programmed learning mate- 
rials, unit tests, the attempts to 
plot profiles of learning, and the use 
of computers as a means of rapidly as- 
sessing learning concurrently, or at 
frequent intervals, as learning occurs. 

The third suggestion is that as- 
sessments are urgently needed of trans- 
fer and long-term perseveration ef- 
fects. Few efforts have been made, as 
yet, to measure the effects of mediated 
learning in one course of instruction 
on more advanced courses. The diffi- 
culties involved in such assessments 
do not justify the neglect of making 
them. The transfer and generalization 
problems are both formidable and im- 
portant. It is suggested that, to pro- 
vide for transfer and generalization, 
such performance training must be pro- 
vided systematically in the instruc- 
tional-learning programs. 

The subject is now open for con- 
structive criticism and extensions by 
the panel members. Far more questions 
have been raised than answers given. 
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